How should you handle redirects and broken links, and assess their impact on crawl budget?

ProcrustesPR

To handle redirects and broken links, first crawl the site and check whether pages have moved, remain valuable, or are no longer relevant. Then decide whether to correct URLs, redirect to relevant content, restore content, or remove links. Do not redirect everything to the homepage just to eliminate errors. Assess crawl budget using the site’s size and logs of actual crawler visits; small sites generally do not need to make it a priority. Fixes help users and crawlers reach content, but do not guarantee higher rankings.

ProcrustesPRProcrustesPRCan a One-Page Website Do SEO?

Find broken links first, then shorten redirect paths

Start by crawling the site to list broken links and URLs with too many redirects, then check whether each link’s final destination is valid. These checks help you determine whether the problem lies in the links, redirect settings, or missing content, rather than jumping straight to deleting pages in bulk.

  • Redirect chains: For example, page A redirects to page B, which then redirects to page C. If page C is the final destination, redirect directly to it to reduce unnecessary hops and loading time.
  • Redirect loops: For example, page A redirects to page B, which redirects back to page A. This prevents visitors from reaching the content and disrupts normal crawling. Fix the settings that send visitors back and forth between the pages.
  • Outdated internal links: When pages change, also update URLs in navigation menus, footers, and further-reading sections. Do not simply add redirects while retaining all the old links.

Before deleting pages, distinguish temporary stock shortages from content that is no longer needed

A product being temporarily out of stock does not mean its page should be deleted. A 2022 article from awoo recommends keeping the product page, marking the item as awaiting restocking, and providing links to related products. If content is no longer relevant, you can remove links pointing to it. If it still receives traffic or offers value to visitors, consider restoring the old content or creating new content.

When a relevant replacement page exists, consider a 301 redirect. In a HubSpot case described by Neil Patel in 2016, incorrect URLs were redirected to relevant pages using 301 redirects. The site also corrected cases where missing pages returned a 200 status code. This is a historical example, not evidence of a current official rule requiring all 404s to be redirected.

As for the claim that keeping hundreds of old product pages would slow down a website, a participant in the public discussion raised this concern without providing speed tests. The same participant speculated that rankings would start from zero after a URL change. That speculation should not be treated as a reason to delete pages either.

Assess the impact using actual crawl logs, not just error counts

The Semrush article notes that adjustments to conserve crawl budget are generally more applicable to large websites, while small sites have less reason to worry. When assessing the impact, look beyond the error list and review server logs to check whether Googlebot actually encounters redirect chains or broken URLs.

In the e-commerce case cited in that article, logs revealed redirect chains and crawl paths that led nowhere, caused by out-of-stock product variants. The management system had not clearly shown these problems. This illustrates the value of checking actual crawl paths, but it cannot tell you how much crawl budget other sites waste.

Sources differ on how much these fixes affect rankings: some warn that large numbers of broken links may be harmful, while others suggest that this type of maintenance may have little impact on rankings, though it generally improves the user experience.

ProcrustesPRProcrustesPRHow to Use a Marketing Funnel: Fill Page Gaps at Each Stage, Then Build a Conversion Path

Handling redirects and broken links: perspectives from across the web

Does a 4xx status code mean a link is broken?

Not necessarily. First check the specific status code and its cause. Forum discussions note that broken links may return 4xx codes, but not all 4xx responses mean a page does not exist. For example, a 403 or 407 response may relate to access settings or authentication. Investigate the cause before deciding whether to correct settings, update the link, or address a destination that genuinely does not exist.

How can you set up permanent redirects on a WordPress site?

Consider a plugin such as Redirection, suggested by forum users, to set up 301 permanent redirects. After setup, verify that the destination URL is valid and check for unnecessary redirects or loops. A successful plugin installation alone is not enough.

How often should you check links, and what should you look for after a site redesign?

Backlinko recommends auditing a site every six months to a year to identify broken links and update URLs. This is maintenance advice, not a fixed schedule that every site must follow. After a redesign, tools that support crawl comparisons can help you compare results from before and after the changes to identify newly introduced redirect loops or broken links.

ProcrustesPRWhat types of URLs are there, and what are they used for?

References

  1. Chaning permalinks on a 1 month old website. How detrimental?www.warriorforum.com — Discusses: How can you set up permanent redirects on a WordPress site?
  2. SEO Tutorial for Beginners: What to Prioritize (and What Not to)www.semrush.com · 2024-06-18T09:35:00Z — Discusses: How can you set up permanent redirects on a WordPress site?
  3. 技術 SEO 初學者指南 (by Ahrefs)tenten.co · 2023-07-30T15:00:24.000Z — Source used in the article above.
  4. The 5-Point Technical SEO Checklist For Bloggersneilpatel.com · 2016-05-02T16:56:01+00:00 — Source used in the article above.
  5. Small Business SEO: 10 Tips to Get Your Website Found Onlinebacklinko.com · 2024-06-17T09:13:21-05:00 — Discusses: How often should you check links, and what should you look for after a site redesign?
  6. Re-ranking a website after replacing URLs and deleting pageswww.warriorforum.com — Source used in the article above.
  7. What Is a Log File Analysis? & How to Do It for SEOwww.semrush.com · 2021-01-04T14:45:00Z — Source used in the article above.
  8. 檢索預算(Crawl Budget)是什麼?中大型網站不可不知的SEO項目!www.awoo.ai · 2022-05-24T06:21:55+00:00 — Source used in the article above.
  9. Internal links are empty in Ahrefswww.warriorforum.com — Discusses: Does a 4xx status code mean a link is broken?
  10. 10 Quick SEO Tips for Better Rankings + More Trafficwww.semrush.com · 2024-09-19T09:59:00Z — Source used in the article above.
  11. Best SEO Software for 2026: Overview & How to Choosewww.semrush.com · 2021-07-19T13:24:00Z — Discusses: How often should you check links, and what should you look for after a site redesign?
  12. Redirect Chain Guide: How To Identify & Fix Redirect Chainsneilpatel.com · 2023-10-09T19:00:00+00:00 — Discusses: How can you set up permanent redirects on a WordPress site?
  13. How to Complete a Comprehensive Technical SEO Site Audit in 9 Easy Stepsneilpatel.com · 2024-12-17T18:12:31+00:00 — Source used in the article above.
  14. Here’s What You Should Do When Your Search Rankings Dropneilpatel.com · 2020-08-25T13:00:00+00:00 — Source used in the article above.

Related articles

Can a One-Page Website Do SEO?How to Use a Marketing Funnel: Fill Page Gaps at Each Stage, Then Build a Conversion PathWhat types of URLs are there, and what are they used for?When should you use relative or absolute paths in WordPress?What are www subdomains and relative links used for?How to Create an HTML Sitemap: From Organizing Content to Publishing and UpdatingHow to troubleshoot and fix 404 errors: identify broken URLs first, then address the causeHow to improve on-site content and structure: audit pages first, then address content gaps and internal links
ProcrustesPR
ProcrustesPR