How do you identify 404s that need attention?

ProcrustesPR

To identify 404s that need attention, cross-check Search Console, website crawl results, and visitor data for each URL. Then check whether links still point to the broken URLs, whether those URLs should be accessible, and whether anyone actually visits them. The goal is not to eliminate every 404, but to identify unexpected situations that lead users to dead ends. It may be entirely normal for a URL that no longer exists to return a 404. An error in a report does not necessarily mean the URL needs to be fixed or redirected.

ProcrustesPRProcrustesPRHow Long Does It Take to Evaluate SEO Results?

Start with a list, and record where the links come from

Search Console can provide clues about 404s Google discovered while crawling; a website crawl can help identify broken links on pages. Cross-check the two rather than treating a single report as a complete list.

  • Check Search Console: Investigate the listed 404s, paying particular attention to cases where a URL has changed but internal links still point to the old location.
  • Run a website crawl: Record the broken URLs found during the crawl, the pages containing those links, and the HTTP status codes the broken URLs return. Do not assume a URL returns a 404 simply because the page will not open.
  • Distinguish between internal and external links: How you handle a broken link depends on whether it points to your own website or another website.

A 2022 Semrush article noted that the Search Console indexing report was based on the last crawl and, at the time, displayed a maximum of 1,000 URLs at once. This is a reminder not to treat the report as a complete, real-time list. However, it describes the report at that time; do not assume the interface or limit is still the same today.

The key question: should this URL have been accessible?

In a 2026 summary of explanations from Google staff, Search Engine Journal noted that requesting a nonexistent URL produces a 404, but this does not necessarily mean there is a problem with the website itself. Search Console is better used to observe patterns and trends than as a checklist for eliminating errors one by one.

  • Worth investigating: A page has moved to a new URL, but navigation or articles still link to the old URL. In this case, the problem is that the links were not updated.
  • Not necessarily something to fix: The content genuinely no longer exists, and a 404 is the expected response. Do not decide to redirect a URL simply because it appears in red in a report.
  • Check for a shared cause: When multiple issues follow a similar pattern, investigate whether they have a common cause rather than treating each as an unrelated error.

Use actual visits to prioritize investigations

Prioritize broken URLs that still receive visitors for manual review. In a 2025 article about URLs generated by AI hallucinations, Ahrefs demonstrated how to filter for URLs that return a 404 but still receive visitors. The author used a threshold of more than 10 visitors per month, but explicitly said it could be adjusted to suit the website; it was not a universal standard.

When using this approach, there is another important check: first establish whether the URL is fabricated or once pointed to a real page that has become unavailable for another reason. For example, if a URL looks like an article path, do not assume the page never existed based on its name alone. Traffic can help set investigation priorities, but it cannot determine on its own whether a redirect is appropriate. In that example, redirects are considered only when a relevant page exists and redirecting to it makes sense.

ProcrustesPRProcrustesPRWhere should I start if I want to do SEO myself?

Identifying and handling 404s: perspectives from across the web

After finding broken links, how should you handle internal and external links differently?

First, check whether the broken URL points to your own website or another website. For internal links, if a new URL exists, you can update the link or consider setting up a redirect; if there is no replacement page, you can remove the link. For external links, you can point them to reliable alternative resources, or remove them if no suitable alternative is available. Before taking action, check the status of the destination page rather than redirecting every broken URL indiscriminately.

How can you inventory old pages that are no longer in the search index?

If you still have the old website files, consider using tools such as Xenu Link Sleuth to help inventory the old pages. This can help recover URLs that have been removed from Google's index because they returned 404s but may still have external links pointing to them. This suggestion depends on the old files still being available. After finding the URLs, you still need to assess each one to determine whether it needs attention, rather than assuming they all require redirects.

Is manually clicking through each URL the only way to check a large number of URLs?

No. You can use website crawling or broken-link checking tools to run checks at a larger scale, then investigate the results. Clicking through URLs individually is time-consuming and can make it difficult to distinguish ordinary 404s from soft 404s. Semrush's 2022 article also mentioned that Search Console's indexing report could provide clues about both types of URLs, but its interface and data presentation at the time should not be assumed to reflect how it works today.

ProcrustesPRShould I rewrite or update an old article that does not rank?

References

  1. Is there an easier way to implement 301 redirects when converting a site to WordPresswebmasters.stackexchange.com — Discusses: How can you inventory old pages that are no longer in the search index?
  2. Google Downplays Search Console “Error” Reports. Says Many Aren’t Real Problemswww.searchenginejournal.com · 2026-07-20T10:42:07+00:00 — Discusses: How can you inventory old pages that are no longer in the search index?
  3. Broken Links: Common Causes and How to Fix Themwww.semrush.com · 2021-06-07T21:58:00Z — Discusses: After finding broken links, how should you handle internal and external links differently?
  4. New Study: How Often Do AI Assistants Hallucinate Links? (16 Million URLs Studied)ahrefs.com · 2025-09-02T09:32:10+00:00 — Source used in the article above.
  5. What Is a 404 Error? How It Affects SEO & How to Fix Itwww.semrush.com · 2022-10-31T13:27:00Z — Discusses: Is manually clicking through each URL the only way to check a large number of URLs?

Related articles

How Long Does It Take to Evaluate SEO Results?Where should I start if I want to do SEO myself?Should I rewrite or update an old article that does not rank?What should I check when organic traffic suddenly drops?Why can I not find my published article on Google?Will Reposting Social Content on My Website Cause a Duplicate-Content Penalty?Eight SEO essentials for beginners: Getting your pages indexedWhat Is SEO? Understanding Optimization Priorities Through How Search Engines Work
ProcrustesPR
ProcrustesPR