Checking sitemaps and mobile pages involves two main questions: Does the sitemap include all important URLs and allow search engines to access them? Does content display correctly on phones, and are the pages easy to use? For sitemaps, checking that the file exists is not enough; you also need to review its contents and check for errors. For mobile pages, passing a tool’s checks is not enough either. Compare what search engine crawlers see with what actually appears on a phone, and test menus, links, and forms.
Check the sitemap and any sitemaps it lists
Locate the sitemap, confirm that it is accessible, and check whether it includes the pages you want search engines to crawl and index. If you open a sitemap index, check each sitemap listed within it rather than stopping after confirming that the index file opens.
- Check for missing important pages and URLs that should not be in the sitemap.
- Use a website crawler to check for formatting errors, broken URLs, oversized files, and other issues.
- Identify orphan pages that appear in the sitemap but have no incoming links from other pages on the site.
Even if orphan pages appear in a sitemap, they still cannot be reached through links from other pages on the site. Semrush explains that this may make them harder to find and may limit their chances of ranking well. Being listed in a sitemap does not mean a page has adequate internal links.
A successfully processed sitemap does not mean its pages are indexed
After reviewing the sitemap, check the relevant statuses in Search Console. Semrush’s Search Console guide explains that a successful sitemap status means Google can process the file and discover its URLs; it does not mean that all those pages have been indexed.
If important pages are missing from search results, a successful sitemap status alone does not rule out problems. You should still review the indexing status of individual URLs and the reasons given. Likewise, after a site audit identifies errors, fix them and run the checks again rather than stopping at the first scan report.
Compare the crawler’s view with the actual display on a phone
When checking mobile rendering, compare the content, images, and layout in these two views rather than relying solely on a tool’s verdict.
The test version of the Edelweiss blog featured by Semrush in 2021 is an example of a site that a tool deemed mobile-friendly even though the crawler’s view differed from the actual display on a phone. In that case, the problem was attributed to robots.txt not allowing sufficient access to CSS, JavaScript, and images. This was a diagnosis for a specific website, not a reason to add Allow directives for every rendering issue. First, identify which resources are being blocked.
Test the page on a phone, from reading to tapping
- Is the text too small, or does the content extend beyond the screen width?
- Are links and buttons too close together, and can users tap them accurately with a finger?
- Is the menu easy to open and use to find the pages you need, and do interactive elements such as forms work properly?
The footer also deserves a separate check. For example, a responsive layout can use fewer columns on phones and adjust link sizes and spacing. Even if this requires a little more scrolling, prioritize making links readable and easy to tap rather than simply minimizing the footer’s height.
Sitemaps and mobile page rendering: perspectives from across the web
Where can you start investigating when a sitemap cannot be fetched?
If Search Console reports that it could not fetch a sitemap, use the URL Inspection tool to run a live test and investigate access issues. If it reports sitemap errors, review the listed issues and follow the guidance to fix them. You can also check robots.txt, relevant redirects, and server settings, but act on actual diagnostic findings rather than assuming any one of these is the cause.
Does a small website always need an XML sitemap?
Not necessarily. A 2021 Semrush article states that a site with no more than 1,000 pages and an excellent internal linking structure may not need an XML sitemap. This is conditional advice, not a suggestion that all small sites can skip one. By contrast, search engines may have more difficulty finding every page on a large site without a sitemap.
How often should you check a sitemap?
You can include sitemap checks in routine maintenance. An article by Neil Patel recommends checking once or twice a month with a site audit tool, because problems can still arise later even if you followed the steps when creating the sitemap. This is the author's recommended frequency, not a platform requirement. When you find a problem, follow the report's guidance to address it and check again to verify the fix.
Can automated scans replace mobile accessibility checks?
Not entirely. Automated tools can help identify accessibility issues on particular devices or screen sizes, including problems with links, images, videos, and form fields. However, Semrush also cautions that automated tools are not a complete accessibility solution. They still need to be combined with manual checks and user testing to address the limitations of scanning.
References
- High number of excluded (not indexed) pages in Google Search Consolewww.warriorforum.com — Discusses: Where can you start investigating when a sitemap cannot be fetched?
- What Is a Sitemap? Website Sitemaps Explainedwww.semrush.com · 2021-05-24T11:55:00Z — Discusses: How often should you check a sitemap?
- 8 Steps to Perform a Technical SEO Audit for a Client’s Blogwww.semrush.com · 2021-11-22T10:50:00Z — Discusses: Does a small website always need an XML sitemap?
- Check Website Accessibility: Manual Checks and Tools to Use in 2025www.semrush.com · 2024-02-14T13:51:00Z — Discusses: Can automated scans replace mobile accessibility checks?
- Google Search Console: the ultimate guide for 2026www.semrush.com · 2019-10-30T07:00:00Z — Discusses: Where can you start investigating when a sitemap cannot be fetched?
- How to Create an SEO-Boosting XML Sitemap in 20 Minutes (or Less)neilpatel.com · 2021-09-30T22:00:00+00:00 — Discusses: How often should you check a sitemap?
- What Are Footer Links? Why They Matter + Tipswww.semrush.com · 2024-11-06T15:29:00Z — Source used in the article above.
- How to do a website audit in 2026 (+ free tracker)www.semrush.com · 2023-12-28T11:37:00Z — Source used in the article above.
- WordPress Sitemap: How to Create, Check, and Submit Onewww.semrush.com · 2021-09-07T13:30:00Z — Source used in the article above.
- Enterprise SEO Audit: A Step-by-Step Guide for Site Ownerswww.semrush.com · 2023-11-14T09:55:00Z — Discusses: Does a small website always need an XML sitemap?



