indexing issues

onedaydayone · May 13, 2026

My website has started indexing multiple filtered pages, such as "?from" or "?category".

As I understand it, robots.txt only prevents Google from crawling pages, but it does not prevent them from being indexed.

For some reason, Google still decided to index these URLs, so using disallow in robots.txt no longer seems effective in this case.

Using a noindex, follow tag is also not an ideal solution because, in my CMS, I cannot apply it only to those specific filtered pages. If I add it globally, the main pages would become noindexed as well.

The canonical tags are already set correctly and point to the main page instead being self-canonicalized.

How could I solve this issue?

onedaydayone · May 13, 2026

I don’t want those pages to be indexed.

One example is URLs containing "&sort=most-popular". I already have a general /collection page for all of my products, so these filtered versions are unnecessary.

Google has also started indexing my .xml URLs.

blackfighter01 · May 13, 2026

I had same issue, google still indexed parameter pages even with canonical. removing internal links to those URLs and adding noindex helped more than robots.txt.

onedaydayone · May 13, 2026

Can I really apply a noindex tag to pages like "sitemap_products_1.xml?from?"

onedaydayone · May 13, 2026

I don’t understand at all how those .xml files ended up appearing in g search.

CaoM1 · May 13, 2026

You should use a canonical url, so all variations of the url are not indexed and only the canonical url is indexed

Hasnain ahmed · May 18, 2026

If Canonical Tags are Already Correct, Try Blocking Those Parameter URLs Through URL Parameter Handling, Internal Linking Cleanup, And Removing Crawl Paths That Generate Them.

Thanks

King Gener · May 18, 2026

If you already have a canonical tag from the filtered URLs that points back to the main page, Google will most likely filter out the URLs gradually. Ensure that you do not include these parameter URLs in your sitemap, and ensure that they are not linked internally. You should also refrain from blocking the URLs via robots.txt immediately, since Google needs to crawl the URL.

Iqra Sardar · May 18, 2026

If canonical tags are already correct, the issue is usually internal linking or parameter URLs being discoverable through filters/navigation.

I’d focus on reducing crawl paths to those URLs and letting Google process the canonical signals before blocking them completely.

APIFuel · May 18, 2026

Yeah, this happens a lot with faceted/filter URLs and it can get messy fast if Google starts discovering too many parameter combinations.

ShadowbladeStorm · May 19, 2026

add noindex directly to those filtered URLs via your CMS if possible, if not use Google Search Console to request removal temporarily, also check if pagination or filter parameters can be consolidated using URL parameter handling in Search Console settings.

Marco69 · Jun 24, 2026

Check it yourself with screaming frog tool (or test trial),you will be shocked that most free cms and especial wordpress(!) the free version, the core code generates tons of parameter urls, tons of 100,500-1000,.....that's not a joke.

And this is causing a poor site structure quality for google, consequencies: google stips crawling and indexing your site ! Google says it clear that no matter if you inject code snippets or some robot.txt settings to prevent google indexing, google not give a guarantee.

A big lie and trap that first-class cms right? This is the reason why I not use wp. In their wordpress.com vip plans you not have these problems , this is why big influencers and big sites or media news sites using wordpress.com vip plan. A difference like day and night between your free wordpress selfhost.

Check it ypourself and take down your pink glass that wordpress is a first-class cms.

Larissa Pereira · Jun 29, 2026

Same issue here. Google seems much more selective than before. Quality content alone doesn't always guarantee fast indexing anymore.

Marco69 · Jun 29, 2026

Larissa Pereira said:
Same issue here. Google seems much more selective than before. Quality content alone doesn't always guarantee fast indexing anymore.

When your cms creates tons of messy parameter urls, then no matters if you have quality content, because google stops crawling your site.

matese · Jun 29, 2026

onedaydayone said:
My website has started indexing multiple filtered pages, such as "?from" or "?category".

As I understand it, robots.txt only prevents Google from crawling pages, but it does not prevent them from being indexed.

For some reason, Google still decided to index these URLs, so using disallow in robots.txt no longer seems effective in this case.

Using a noindex, follow tag is also not an ideal solution because, in my CMS, I cannot apply it only to those specific filtered pages. If I add it globally, the main pages would become noindexed as well.

The canonical tags are already set correctly and point to the main page instead being self-canonicalized.

How could I solve this issue?

assuming that the canonical tag of the website are already in place the next thing to do is to check how gogle find these URL. Internal linkng and sitemap might provide some answer here.

Marco69 · Jun 29, 2026

When the WP community will ever learn that their "first-class" free wp - no tonly the plugins (!) creates mass of parameter urls.....

Starblazer · Jun 29, 2026

Robots.txt file doesn't even block crawlers, it's just a guidelines file that suggests crawlers to skip some pages. However, the crawlers can ignore these guidelines and crawl them anyway.

The ideal practice is to allow crawling of entire site that's accessible to users and then set canonical tag, noindex tag, etc. to tell search engines what to show in SERPs.

NexionSEO · Jun 29, 2026

If Google has already indexed those parameter URLs a robots.txt disallow can actually make the problem worse because Google cant recrawl the pages to see your canonical tags or a future noindex directive.

A few things I'd check, make sure those filtered URLs are not linked internally anywhere on the site, keep the canonical tags pointing to the main pages, if possible return a 301 redirect from unnecessary parameter URLs to the clean version. If the filtered pages have no value at all consider returning a 404 or 410 status for them and use the URL removal tool in Google Search Console for a temporary cleanup while Google processes the changes.

In most cases once Google stops finding internal links to those parameter URLs and keeps seeing the canonical to the main page they gradually drop out of the index.

Marco69 · Jun 29, 2026

Starblazer said:
Robots.txt file doesn't even block crawlers, it's just a guidelines file that suggests crawlers to skip some pages. However, the crawlers can ignore these guidelines and crawl them anyway.

The ideal practice is to allow crawling of entire site that's accessible to users and then set canonical tag, noindex tag, etc. to tell search engines what to show in SERPs.

Use canonical tags or not, wil not fix it and by the way, wp not does this automatical, you need another plugin -- creates more of these messy urls...

Use a cms who not produce this messy urls, then you are beyond 90% of all these free selfhost website owners.

tekochi · Jun 29, 2026

Try to add a parameter handling rule in GSC under the URL parameters section and tell Google those parameters don’t change page content. alternatively if your CMS allows conditional logic you can apply noindex only when a query string is present in the URL without affecting clean URLs.

indexing issues

Regular Member

Regular Member

Regular Member

Regular Member

Regular Member

Junior Member

BANNED

Elite Member

BANNED

BANNED

Registered Member

Elite Member

Junior Member

Elite Member

Newbie

Elite Member

Elite Member

Regular Member

Elite Member

BANNED

Main Menu

Marketplace

Making Money

BlackHat World