Does blocking directories or URLs targeted by internal links in robots.txt affect SEO and rankings?

ProcrustesPR

It may affect SEO, but internal links pointing to blocked URLs alone do not prove that rankings have suffered. First, check whether robots.txt blocks the link’s destination or the page containing the link. robots.txt prevents crawling; it does not guarantee that a URL will disappear from search results. If you accidentally block content you want people to find through search, you need to address it. If the URL is simply generated automatically by the platform and contains nothing you want indexed, it may not be a problem. The 1,427 URLs mentioned in the public discussion also cannot be directly translated into losses in link value or rankings.

ProcrustesPRProcrustesPRHow Long Does It Take to Evaluate SEO Results?

First, check which end of the link is blocked

In the product-filtering case discussed publicly, a blog linked to specific filtered results, and the filtered-result URLs were blocked by robots.txt; the blog itself was not blocked. The person asking the question wanted to prevent large numbers of filtered pages from being indexed, but preventing crawling is not the same as preventing indexing.

  • Blocking the link destination: Search engines may still discover the URL through links on other pages, but they cannot crawl the destination’s content.
  • Blocking the page containing the link: Search engines cannot crawl that page and read its outgoing links. This differs from blocking only the filtered-result pages, so the same assessment does not necessarily apply.

First check which directories and URLs the blocking rules cover, then identify the pages linking to them. Do not remove all blocking rules simply because you see a warning.

Disallow alone cannot prevent indexing

Related technical discussions note that blocked URLs with links pointing to them may continue to appear in search results, sometimes as just a URL without a description. Preventing crawling therefore does not guarantee exclusion from the index.

If a page needs to remain available but you do not want it to appear in search results, consider adding a noindex tag to the page or setting noindex through an X-Robots-Tag in the HTTP response. Crawlers must also be able to read that setting; if robots.txt still blocks crawling, they cannot read it. If a filtered page contains content you want people to find through search, excluding it from the index is not the appropriate fix.

Concerns about link value warrant investigation, but do not prove ranking losses

In a 2015 article, Screaming Frog suggested that blocked URLs may still accumulate PageRank, but because Google cannot crawl their content or read their outgoing links, they may create a “dead end” for passing PageRank on. That analysis cannot be used to quantify current ranking losses.

Following its recommendations, you can check how many URLs are blocked, how many links point to them, and their link depth. Tool warnings also need to be understood in context: in 2022, the company explained that these items were classified as high priority because accidental blocking can have a major impact, not because every warning indicates an existing problem.

Assess platform-generated links case by case

In July 2026, Search Engine Journal reported on a Squarespace case in which automatically generated internal links pointed to blocked URLs, and the user could not remove the links. John Mueller advised ignoring the link in that case, saying that no action was needed if the linked content did not need to be indexed.

This response does not mean that all blocked internal URLs are harmless. It does, however, remind us that finding a link with a tool does not mean it must be deleted. What matters is whether the linked content needs to be discoverable through search, not simply reducing the warning count to zero.

ProcrustesPRProcrustesPRWhere should I start if I want to do SEO myself?

Internal links to URLs blocked by robots.txt: perspectives from across the web

Should you remove blog links to blocked filtered results?

Not necessarily. These links may take readers directly to specific filtered product results, so consider their purpose before deciding whether to keep them. If you want to adjust these links, you can use Screaming Frog to identify the pages linking to blocked URLs, then assess whether to remove the links or add rel="nofollow". nofollow is only a hint to Google, not a directive it must follow.

If you do not want filtered pages in search results, how should you use noindex alongside blocking rules?

If filtered pages need to remain available but you do not want them indexed, consider adding noindex to the pages or setting an X-Robots-Tag in the HTTP response. In that case, do not let robots.txt prevent crawlers from reading the setting; blocking crawling alone may still allow URLs with links pointing to them to appear in search results. This approach applies to filtered pages you have decided to exclude from the index, not pages you want people to find through search.

If platform-generated links cannot be deleted, do you have to switch platforms or fix them?

Not necessarily. In the Squarespace case reported in 2026, platform-generated links pointed to blocked URLs, and the user could not delete them through the administrative interface. John Mueller advised ignoring the link, provided there was no content behind it that the user wanted indexed. This response addressed the specific situation described; it does not imply that all blocked URLs generated by platforms can be left unchecked.

ProcrustesPRShould I rewrite or update an old article that does not rank?

References

  1. Robots.txt & internal filter links blockedwww.warriorforum.com — Discusses: Should you remove blog links to blocked filtered results?
  2. How to de-index pages from google using robots.txtwebmasters.stackexchange.com — Discusses: If you do not want filtered pages in search results, how should you use noindex alongside blocking rules?
  3. What is technical SEO? Basics and best practiceswww.semrush.com · 2023-02-01T15:56:00Z — Discusses: If you do not want filtered pages in search results, how should you use noindex alongside blocking rules?
  4. Google Explains Why URLs Blocked By Robots.txt Can Still Be Indexedwww.searchenginejournal.com · 2026-06-17T10:58:48+00:00 — Discusses: Should you remove blog links to blocked filtered results?
  5. Screaming Frog SEO Spider Update – Version 5.0www.screamingfrog.co.uk · 2015-09-04T13:41:52+00:00 — Source used in the article above.
  6. Google On SEO Impact Of URLs Injected By CMS Platformswww.searchenginejournal.com · 2026-07-29T00:38:31+00:00 — Discusses: If platform-generated links cannot be deleted, do you have to switch platforms or fix them?
  7. Screaming Frog SEO Spider Update – Version 17.0www.screamingfrog.co.uk · 2022-08-17T07:33:58+00:00 — Source used in the article above.

Related articles

How Long Does It Take to Evaluate SEO Results?Where should I start if I want to do SEO myself?Should I rewrite or update an old article that does not rank?What should I check when organic traffic suddenly drops?Why can I not find my published article on Google?Will Reposting Social Content on My Website Cause a Duplicate-Content Penalty?Eight SEO essentials for beginners: Getting your pages indexedWhat Is SEO? Understanding Optimization Priorities Through How Search Engines Work
ProcrustesPR
ProcrustesPR