Removing pages that are no longer needed and having their URLs return 404 responses does not mean a website will be penalized, nor does it hurt other working pages. However, deleting a page that previously attracted organic search traffic means losing that page’s traffic. If internal links still point to it, readers will also reach a dead end. The goal is not to reduce the number of 404s to zero, but to assess whether a page is still useful, whether suitable replacement content exists, and whether links have been updated.
404 responses and the losses caused by deleting pages are separate issues
In an October 2026 report, Search Engine Journal quoted Google’s Gary Illyes explaining that 404s are a normal part of the web. Once Googlebot discovers that a page no longer exists, Google will eventually remove the URL from its index without penalizing other working pages. That does not mean deleting pages has no cost.
Semrush’s 2024 content pruning guide notes that deleting a page that brought in organic traffic also means losing that traffic. A decline in total website traffic therefore cannot be equated with a sitewide penalty. Before deleting a page, check whether people still need it.
noindex does not mean deleting a page, nor does it automatically produce a 404
Do not confuse “adding noindex and nofollow” with “generating large numbers of 404s.” noindex controls whether a page is indexed; a 404 response indicates that a page cannot be found at a URL. They are not the same thing. Google’s ecommerce documentation distinguishes between two scenarios for empty category pages:
- If a category contains no items, you can use noindex to keep the page out of the index.
- If the website has automatically removed the empty category from internal search and no longer makes it available for browsing, returning a 404 is recommended.
First decide whether the page should remain available for people to browse, then choose how to handle it. Do not simply delete every page you want to keep out of search results.
Redirect pages that have moved; return a 404 when they no longer exist
Google’s documentation on URL changes recommends handling each situation as follows:
- Permanently moved to a new URL: Use a 301 redirect to send visitors from the old URL to the new location.
- Temporarily moved: Use a 302 redirect.
- Content genuinely removed: Have the URL for the missing page return a genuine 404 response. You can design a custom error page to improve the browsing experience, but it must return the correct status code rather than merely display an error message.
If a relevant replacement resource exists, Semrush’s 2024 guide recommends considering a 301 redirect. Internal links also need to be updated after a page is deleted. For example, if an event page has been taken down, the navigation menu should no longer direct readers to it.
Pages that should exist but unexpectedly return a 404 should be fixed, not ignored as routine deletions.
Deleting pages and returning 404s: perspectives from across the web
After adding noindex to a page, should you also block Googlebot using robots.txt?
If you want Googlebot to see noindex, do not also use robots.txt to block it from crawling the page; otherwise, it may not see the signal to remove the page from the index. The same applies to deleted pages whose status Googlebot needs to discover. Another participant listed robots.txt as an option, but blocking crawling is not a reliable way to remove a URL from search results.
Must you use 410 rather than 404 when permanently deleting a page?
Not necessarily. Google’s documentation accepts genuine 404 responses for pages that no longer exist. Some webmasters recommend using 410 for permanent deletions, arguing that it sends a stronger removal signal than a 404, which might be accidental. These differing recommendations do not make 410 the only correct approach. Also, do not assume that timelines for removal from the index mentioned in older discussions still apply today.
Can Search Console’s list of 404s serve as a complete inventory?
No. Semrush notes that the Page indexing report reflects Google’s most recent crawl, and new errors may have appeared since then. The report also displays a maximum of 1,000 URLs. The list can therefore be used to review detected examples of 404s and soft 404s, but the absence of a URL from the list does not establish that the website has no other issues.
References
- 技術性搜尋引擎最佳化 (SEO) 技巧與策略 | Google 搜尋中心 | Documentation | Google for Developersdevelopers.google.com — Discusses: Must you use 410 rather than 404 when permanently deleting a page?
- 電子商務網址結構的最佳做法 | Google 搜尋中心 | Documentation | Google for Developersdevelopers.google.com — Source used in the article above.
- How to Remove URLs from Google Search Enginewebmasters.stackexchange.com — Discusses: After adding noindex to a page, should you also block Googlebot using robots.txt?
- Google Recommends Using Custom 404 Error Pageswww.searchenginejournal.com · 2026-10-29T11:07:37+00:00 — Source used in the article above.
- How to Remove URLs from Google Search Enginewebmasters.stackexchange.com — Discusses: After adding noindex to a page, should you also block Googlebot using robots.txt?
- How to Remove URLs from Google Search Enginewebmasters.stackexchange.com — Discusses: Must you use 410 rather than 404 when permanently deleting a page?
- Content Pruning: A Step-by-Step Guide to Improving Your SEOwww.semrush.com · 2024-05-09T09:05:00Z — Source used in the article above.
- What Is a 404 Error? How It Affects SEO & How to Fix Itwww.semrush.com · 2022-10-31T13:27:00Z — Discusses: Can Search Console’s list of 404s serve as a complete inventory?



