Why might a page still appear in search results after deindexing?

ProcrustesPR

A page still appearing in Google search results does not necessarily mean that deindexing has failed. Crawling may simply have been blocked, Google may not have recrawled the page since noindex was added, or the removal request may have only a temporary effect. Other URLs pointing to the same content may also have been overlooked. First, confirm what action was taken, then check the exact URL in the search results. Changing settings or submitting a request does not mean permanent removal is complete.

ProcrustesPRProcrustesPRHow Long Does It Take to Evaluate SEO Results?

Blocking crawling does not prevent a URL from appearing in search results

robots.txt controls whether Googlebot can crawl a page; it is not a tool for removing pages from the index. Google’s official documentation states that a URL may still appear in search results even if robots.txt blocks crawling. To instruct Google not to index a page, use noindex and allow Google to crawl the URL.

For example, if a page remains publicly available, adding a rule in robots.txt to block crawling does not mean it has been removed from search results. To keep the page available to readers without having it appear in Google Search, use noindex rather than simply blocking crawling.

Adding noindex does not mean Google has read it yet

A 2024 Semrush article notes that a page may still appear in search results if Google has not recrawled it since noindex was added. Even after a recrawl request is submitted, search results may take time to update. There is no guarantee that the page will disappear within a few days.

  • First, check the URL in the search results to avoid inspecting a different version.
  • Confirm that noindex is set on the page and that robots.txt is not also blocking Google from crawling it.
  • Use Search Console’s URL Inspection tool to check the page’s status. Do not assume Google has finished processing the change just because the code has been updated.

Temporary removals expire, and the same content may have multiple URLs

Google’s official guidance states that requests made through the Removals tool remain effective for about six months. To permanently prevent a page from appearing in search results, you also need to remove or update the content, password-protect it, or add noindex. Do not rely solely on the tool’s temporary effect.

The same page may also be accessible through multiple URLs, such as /puppies, /PUPPIES, and /petchooser?pet=puppies. Google notes that all URL variations must be addressed when removing specific content. If the same content reappears, compare the URLs first rather than assuming the original removal request did not take effect.

Finally, being absent from search results does not mean a page is inaccessible. noindex does not prevent users from opening a page directly, and it cannot be relied on to work with search engines that do not support it. If the content itself should not be public, restrict access or remove it rather than relying solely on its disappearance from search results.

ProcrustesPRProcrustesPRWhere should I start if I want to do SEO myself?

Pages still appearing in search results after deindexing: perspectives from across the web

Why can a deleted page still be found in search results?

Deleting a page from a website does not mean search results will update immediately. Semrush notes that deleted pages may temporarily remain in the results, with users encountering a 404 error when they click through. First, confirm that the URL in the results is indeed the deleted page. If links to it remain on other websites or within your own site, users may also reach the error page through those links.

Why does Search Console still report crawl errors after a URL has disappeared from search results?

Removing a URL from search results does not mean Search Console will stop reporting crawl errors for it. An answer on Stack Exchange explains that if Google continues to discover links to the URL and it returns 404 or 410, it may still be reported as a crawl error. This does not necessarily mean it has reappeared in search results.

Why does a video's watch page remain in search results after the video no longer appears?

Google explains that if a video's specified expiration date has passed, the video will not appear in search results, but its watch page may still appear as a text result without a video thumbnail. A video result disappearing therefore does not mean the entire page has been removed. If the video is still available to watch, check that its expiration date has not been set too early. Videos that do not expire should not include expiration information.

ProcrustesPRShould I rewrite or update an old article that does not rank?

References

  1. Google 搜尋技術相關規定 | Google 搜尋中心  |  Documentation  |  Google for Developersdevelopers.google.com — Source used in the article above.
  2. 影片搜尋引擎最佳化 (SEO) 最佳做法 | Google 搜尋中心  |  Documentation  |  Google for Developersdevelopers.google.com — Discusses: Why does a video's watch page remain in search results after the video no longer appears?
  3. 從 Google 中移除您的網站資訊 | Google 搜尋中心  |  Documentation  |  Google for Developersdevelopers.google.com — Source used in the article above.
  4. How to Remove Outdated Content Using Google Toolswww.semrush.com · 2021-08-19T15:04:00Z — Discusses: Why can a deleted page still be found in search results?
  5. What Is Noindex Used for? An Overview + Best Practiceswww.semrush.com · 2024-07-31T12:14:00Z — Source used in the article above.
  6. How to Remove URLs from Google Search Enginewebmasters.stackexchange.com — Discusses: Why does Search Console still report crawl errors after a URL has disappeared from search results?

Related articles

How Long Does It Take to Evaluate SEO Results?Where should I start if I want to do SEO myself?Should I rewrite or update an old article that does not rank?What should I check when organic traffic suddenly drops?Why can I not find my published article on Google?Will Reposting Social Content on My Website Cause a Duplicate-Content Penalty?Eight SEO essentials for beginners: Getting your pages indexedWhat Is SEO? Understanding Optimization Priorities Through How Search Engines Work
ProcrustesPR
ProcrustesPR