What is faceted navigation?

A facet is an attribute used to narrow a result set. Selecting a color and then a size restricts the same collection by both values. Filtering can change URL parameters, path segments or only the displayed state; a new crawlable URL is an implementation choice, not a requirement of every filter.

Google: Faceted URL crawling.

Why URL combinations need a policy

Google warns that parameter-based faceted navigation can create very large or infinite URL spaces. Crawlers may need to request a URL before learning whether it is useful. Spending resources on unwanted filter states can slow discovery of useful new URLs. That does not establish a fixed daily crawl allowance or a guaranteed ranking penalty for every filtered page.

Google: Faceted URL crawling.

Follow the filter state into the URL

In this illustrative catalog, selecting two filters yields /shoes/?color=red&size=10. Adding a sort option may create another URL with the same items in a different order. Inspect the actual links and responses rather than inferring crawl behavior from the visible controls. Google recommends the standard ampersand separator for parameters and a consistent filter order for path-based URLs.

Google: Faceted URL crawling.

Match the control to the intended result

Crawling, indexing and canonicalization are separate controls
ControlIntended useLimit
robots.txt disallowPrevent crawling of unwanted filter URL patterns.Does not reliably remove an already known URL from search results.
noindexExclude a page from search results after the rule is read.Google must be allowed to crawl the response to see it.
rel="canonical"Suggest a preferred URL among duplicate or very similar pages.A canonical is a signal, not a crawl prohibition.
Crawlable filtered landing pageMake a useful, distinct filtered result available to search.Needs stable URLs and valid responses, not automatic indexing of every combination.

Google: Faceted URL crawling. Google: Robots meta rules. Google: Canonical URL guidance.

Illustrative filter URL decisions

Imagine a shop with a useful red-running-shoes collection and an arbitrary price-sort state. The collection could have a stable, crawlable URL because it helps readers find a distinct set of products. The price-sort state may be unnecessary as a separate search destination. This is a hypothetical decision example, not evidence of demand or traffic for either page.

Facets narrow which items match; pagination divides a result set into successive pages. A second page can contain items absent from the first page. Do not automatically canonicalize or block the entire paginated sequence merely because filter URLs need controls.

Google: Pagination and incremental loading.

Check useful and unwanted states

Identify the filtered destinations you want search engines to reach, then test the other URL patterns against your crawl policy. For crawlable states, keep URL construction consistent and prevent duplicate filters. Google recommends HTTP 404 for combinations with no results, nonsensical filters and nonexistent pagination URLs, served at the requested URL. Single-page applications may need a different implementation path under Google’s linked guidance.

Google: Faceted URL crawling.

Do not hide a rule behind a crawl block

A robots.txt block prevents Google from fetching a page’s noindex or canonical annotation. If an already indexed URL needs removal, the sequence of changes matters: a noindex cannot work until Google can read it. Canonicalization is appropriate for duplicate or very similar pages, rather than a universal instruction to collapse every filtered collection into its unfiltered parent.

Google: Robots meta rules. Google: Canonical URL guidance.

Record what the audit actually observes

Keep representative URLs for an intended landing page, an unwanted filter, a sort state and an empty result. For each, record the HTTP status, crawl permission, indexing rule and canonical destination. Compare that evidence with the intended policy; a large URL count alone does not identify which change to make.

Questions about faceted navigation

Does faceted navigation always hurt SEO?

Facets are useful navigation. The risk comes from the URLs and resources an implementation exposes. Google recommends preventing crawling of unwanted filter states and making needed crawlable states consistent.

Should I use noindex or canonical for filter pages?

Noindex excludes a page from search after Google reads the rule. A canonical suggests a preferred version among duplicate or very similar pages. Neither is a substitute for deciding which URLs should be crawled.

Can filters use URL fragments?

Google generally does not use URL fragments for crawling and indexing. Fragment-based filters can avoid separate crawled filter URLs, but they are unsuitable when those states need individual search destinations.

Pagination · Crawl Budget · Duplicate Content · Canonical URL · Robots.txt

Sources