To find a sitemap, start with /sitemap.xml at the website’s root, then look for clues in sitemap indexes and robots.txt. If you have Search Console access, you can also check submitted sitemap records. Once you find the sitemap, check more than whether the file exists: review its XML format, whether the listed URLs belong there, whether any return 404 errors, and whether internal links point to the pages. Not finding a sitemap through a search engine does not mean the website has none; search results can only show content that the search engine has indexed.
Start with common paths, then follow the index
This guide focuses on XML sitemaps commonly used for SEO, rather than HTML sitemaps that help visitors browse website categories. Try these steps in order:
- Check /sitemap.xml: Adding this path after the website’s domain is a common starting point, but not every website keeps its sitemap there.
- Identify sitemap indexes: If you are redirected to /sitemap_index.xml, you may be looking at a list of multiple sitemaps. Open the individual files listed there to see the actual page URLs.
- Check /robots.txt: Search the file for “sitemap” to see whether it specifies a sitemap location. If no path is listed, that does not prove the website has no sitemap.
Search results and submission records offer clues, not a complete list
If you still cannot find it, search for “site:yourdomain filetype:xml” or “site:yourdomain inurl:sitemap”, replacing “yourdomain” with the actual domain. A sitemap can only appear in these results if the search engine you are using has indexed it.
A Semrush article dated 2021 also notes that, with Search Console access, you can review the list of submitted sitemaps to find previously submitted URLs. This offers a place to look, but the feature may not be in the same location in the current interface, and the list only covers previously submitted items. The article suggests that a website may not have an XML sitemap if several methods fail to find one, but that is not a definitive conclusion.
Once you find the file, check its format, URLs, and internal links
Start by checking for the following issues, then use a site audit tool to list the affected items:
- Format and accessibility: Check for missing XML tags and whether the sitemap URL itself returns a 404 error. A 404 could result from a misspelled path, a file that was not uploaded, or a file placed in the wrong directory.
- Included pages: Watch for redirecting URLs and non-canonical URLs to avoid including unsuitable pages in the list.
- Orphan pages: Even if a page is listed in a sitemap, it may still be difficult to discover if no other pages on the website link to it. This may also limit its ranking performance. A sitemap is not a substitute for internal links.
The audit process described in the Semrush article starts with errors, followed by warnings and notices. After making corrections, run the audit again to check whether the original issues have been resolved. Updating the file alone does not complete the check.
Sitemaps: perspectives from across the web
Which URL protocols should you check in an HTTPS website’s sitemap?
If a website uses HTTPS, check whether its sitemap still lists HTTP URLs. Semrush recommends using HTTPS URLs for these websites to avoid duplicate content issues and browser security warnings. Check each affected URL individually, rather than only checking whether the sitemap file itself opens over HTTPS.
Does an oversized sitemap file also need attention?
Yes. Check both the file size and the number of URLs. In an article dated 2021, Semrush lists oversized sitemap files as a potential audit issue. When running an audit, review the affected items flagged by the tool. However, the figures in that article reflect information from that time and should not be assumed to be current platform limits.
What can Search Console help you check?
If you have access to the website’s Search Console, you can use it to submit sitemaps and check for crawling issues. A 2017 Semrush article also recommends checking regularly for new issues. A forum user additionally mentions checking when a sitemap was last crawled, but that record alone does not prove that every URL in the list has been indexed.
Should you look only at the XML sitemap when trying to understand a website’s category structure?
No, you do not need to limit your review to the XML sitemap. One Semrush website structure planning example checks for a visitor-facing HTML sitemap and also examines the main menu, tags, and filters. When analyzing a competitor’s website, it is also necessary to examine each section individually, because the structure may not be immediately apparent on the surface.
References
- Must you submit each new blog post to Google for indexing?www.warriorforum.com — Discusses: What can Search Console help you check?
- What Is a Sitemap? Website Sitemaps Explainedwww.semrush.com · 2021-05-24T11:55:00Z — Discusses: Which URL protocols should you check in an HTTPS website’s sitemap?; Does an oversized sitemap file also need attention?
- Black Hat SEO and White Hat SEO: What's the Difference?www.semrush.com · 2017-12-01T08:00:00Z — Discusses: What can Search Console help you check?
- How an Artisan Bakery Is Gaining a Competitive Advantage with a New Site Structurewww.semrush.com · 2021-07-14T12:35:00Z — Discusses: Should you look only at the XML sitemap when trying to understand a website’s category structure?



