Why do links rot or become lost? Causes, categories, and prevalence

ProcrustesPR

Deleted web pages are not the only cause of link rot. Content updates, URL changes, or broken redirects can also prevent links from leading to the original material. But a tool marking a link as “lost” does not necessarily mean the link has disappeared. In a nine-year study published by Ahrefs in 2022, at least 66.5% of links to the sampled websites had rotted, while 74.5% were classified as lost. These results apply to a particular sample and period; they do not represent the current failure rate across all websites.

ProcrustesPRProcrustesPRDo I have to buy backlinks for SEO?

First, distinguish between missing material and links a tool no longer counts

Link rot means a link no longer leads to the intended file, web page, or server. Even if a URL still opens, changes to its content may make it unsuitable for its original purpose as a reference. “Lost” is a broader category used by the tool. It may also include temporary crawling failures and other conditions the study considered relevant to ranking calculations.

For example, if a linking page switches to a different canonical URL, this may simply reflect a change in which URL is indexed. The Ahrefs article suggests that such cases are generally not a cause for concern and should not automatically be interpreted as deleted links.

Group the causes of link loss by where the change occurs

The lost-link categories Ahrefs listed at the time can be grouped as follows. The percentages are the category shares reported in that study, not rates of occurrence across all links on the web.

  • Pages removed from the tool’s index: The “dropped from the index” category accounted for 47.7%. Possible reasons include pages that cannot be crawled or indexed, or domains that no longer exist. This refers to Ahrefs’ index and does not mean a search engine has removed the page.
  • Pages or links being removed: The “link removed” category accounted for 34.2%, meaning the page still exists but the link does not, potentially because of content updates, replacements, or company policies. The “page not found” category accounted for 4.11%, referring to cases where the page containing the link had been deleted.
  • URL paths changing: 301/302 redirects accounted for 5.99%, and non-canonical pages for 0.82%. The former may accompany website migrations, while the latter may involve switching from HTTP to HTTPS or standardizing URL formats.
  • Pages the tool cannot access, or links it no longer counts: Crawl errors accounted for 6.45%, and noindex for 0.73%. The Ahrefs article also listed a small number of broken redirects, shown as 0% in the table; this should not be read as meaning there were no cases at all.

Lost links may return, or their paths may simply have changed

A crawl error does not mean permanent failure. If a subsequent crawl finds the page accessible and the link still present, Ahrefs counts the link as active again. Persistent errors may eventually lead to the page being removed from the index. The study therefore excluded crawl errors from its total for link rot, along with links that remained present on noindex pages.

Redirects also need to be checked step by step. For example, site A might originally link to site B through site C, then switch to linking directly to site B. According to the Ahrefs article, the old path would still be recorded as lost. This differs from a broken path caused by an unresponsive intermediate page.

Read prevalence figures alongside the study period and sample

The study examined links to 2,062,173 sampled websites from January 2013 onward. The 74.5% classified as lost included at least 66.5% affected by link rot, 6.45% by temporary errors, and 1.55% by other issues. Lost links therefore cannot all be described as dead links.

There were also differences between websites: many small sites in the dataset had lost relatively few links. After excluding sites with ten or fewer active links, larger websites appeared to have lost more. This is an observation about the sample distribution, not sufficient evidence that website size causes link rot. Nor can the overall percentage predict link loss for every website.

ProcrustesPRProcrustesPRHow can I tell whether an SEO tactic breaks spam rules?

Link rot and link loss: perspectives from across the web

How have past studies measured whether links have failed?

Methods have varied. A 2014 study of legal citations, as reported by Ahrefs, found that 70% of links in law journals and 50% of URLs in U.S. Supreme Court opinions no longer contained the originally cited material. A separate 2012 study found that 30% of social media links failed within two years. The former examined whether the originally cited material remained available, while the latter counted link failures. These findings cannot be directly compared or used to estimate the current failure rate across the web.

Can deleted pages containing links come back?

They can, but there is no guarantee. Ahrefs’ study notes that deleted linking pages occasionally come back online or begin redirecting elsewhere. In these cases, the associated links may be recorded as active again or reclassified as redirects. When reviewing a page-not-found record, it is therefore worth checking whether the page has returned and whether it still contains the original link.

Why are links on noindex pages classified as lost?

Because Ahrefs did not count links on noindex pages as active links at the time. In the study published in 2022, these pages could still contain links, but the tool classified those links as lost. The study did not count them as link rot. The study’s author argued that such pages would not be found by search engines and would not pass value. This reflects the study’s explanation and counting method at the time, not necessarily the rules used by all search engines today.

ProcrustesPRWill Reposting Social Content on My Website Cause a Duplicate-Content Penalty?

References

  1. At Least 66.5% of Links to Sites in the Last 9 Years Are Dead (Ahrefs Study on Link Rot)ahrefs.com · 2022-04-29T06:40:30+00:00 — Discusses: How have past studies measured whether links have failed?; Can deleted pages containing links come back?

Related articles

Do I have to buy backlinks for SEO?How can I tell whether an SEO tactic breaks spam rules?Will Reposting Social Content on My Website Cause a Duplicate-Content Penalty?Eight SEO essentials for beginners: BacklinksHow can you use multiple domains to build content and traffic while assessing the risks?How do you choose a new domain and maintain external links?Microsite or multiple landing pages? Separate branding needs from ranking expectations firstDoes Google Penalize Black-Hat SEO? First, Distinguish the Tactics and Scope of Impact
ProcrustesPR
ProcrustesPR