How do you check response codes, canonical URLs, and speed?

ProcrustesPR

When checking response codes, canonical URLs, and speed, focus on whether URLs are accessible, whether duplicate pages point to the intended canonical version, and how pages load on different devices. Start by checking response codes and redirect destinations in bulk, then inspect the canonical and alternate tags in the source code. Finally, use PageSpeed Insights to test mobile and desktop versions separately. Look beyond error warnings: response codes should match the page’s purpose, canonical URLs should point to the correct version, and speed results should be read alongside specific recommendations for improvement.

ProcrustesPRProcrustesPRHow can I tell whether an SEO tactic breaks spam rules?

Response codes: assess working pages, unavailable pages, and redirects separately

Semrush’s 2021 article on pre-launch audits recommends checking response codes with a bulk HTTP status checker or a browser extension such as Link Redirect Trace. Most working pages should return 200, while pages that do not exist should return 404. Do not treat every non-200 result as the same kind of problem.

  • 200: Confirm that pages expected to serve content normally return a success code.
  • 4xx: Check for internal links pointing to unavailable URLs, and update broken links to point to relevant, valid pages.
  • 3xx: Verify that redirect destinations are correct and still relevant to the original content. A 2023 Screaming Frog article recommends updating internal links to spare users unnecessary redirects.

Passing checks on a test domain does not mean the production domain will be problem-free. Run the checks again after moving to the production domain, as the two may have different server configurations.

Canonical URLs: having a tag is not enough—it must point to the right page

A canonical tag tells search crawlers which version of a page is preferred, helping reduce duplicate-content issues. Check the settings directly in the source code or with a tag-checking extension. Also verify that the links to alternative versions listed in alternate tags are correct.

A 2021 awoo article cautions that a default canonical configuration should not simply copy the current URL. For example, if filters or parameters generate duplicate pages and each version points to itself, those pages will not all point to the intended canonical page. The article recommends checking that a default configuration can exclude the variables causing duplication and point to the correct destination before adopting it. This does not mean that all self-referencing canonical configurations are unsuitable.

Speed: test by device and page type, and look beyond the overall rating

Semrush’s 2021 article recommends using PageSpeed Insights to check mobile and desktop versions, covering landing pages, category pages, and the blog homepage. Although the Edelweiss bakery test site in the article received acceptable speed ratings on both device types, there was still room for improvement. This was an individual case, not a benchmark for determining whether other websites pass.

After reviewing the report, plan improvements based on the issues it identifies. The article’s examples include eliminating render-blocking resources, displaying text before fonts finish loading, and using WebP images. These are starting points for checks and improvements. Not every website needs all of these measures, and they do not guarantee higher rankings.

ProcrustesPRProcrustesPRShould I rewrite or update an old article that does not rank?

Response codes, canonical URLs, and speed: perspectives from across the web

Does a response code of -1 necessarily mean the server returned an HTTP error code?

Not necessarily. Version 1.20 of Screaming Frog labeled some pages containing only HTML, without HTTP headers, as -1 and displayed “Invalid HTTP Response.” That label reflected how this version of the tool interpreted the response; it should not be treated as an HTTP status code returned by the server. If you encounter a similar result, check the actual response content and headers.

Should you investigate CSS or JavaScript that is blocked from search crawlers?

Yes. A 2019 Screaming Frog article notes that although these issues had become less common over time, blocked resources could still affect page rendering, crawling, or speed. It recommends crawling with the Googlebot user agent, then reviewing response codes or rendered pages. This is a troubleshooting approach, not a claim that every blocked resource has caused a problem.

Do you still need to address duplicate pages after setting up canonical tags?

Yes. You still need to check what is generating duplicate pages. A 2021 awoo article notes that canonical tags and 301 redirects help address duplicate content, but you still need to decide which duplicate pages are worth keeping. If filters or parameters generate duplicate URLs, also verify that the canonical configuration points to the correct destination. Do not rely solely on tags without addressing the underlying cause.

ProcrustesPRWill Reposting Social Content on My Website Cause a Duplicate-Content Penalty?

References

  1. Screaming Frog SEO Spider Update – Version 1.20www.screamingfrog.co.uk · 2011-01-15T15:35:07+00:00 — Discusses: Does a response code of -1 necessarily mean the server returned an HTTP error code?
  2. 8 Steps to Perform a Technical SEO Audit for a Client’s Blogwww.semrush.com · 2021-11-22T10:50:00Z — Source used in the article above.
  3. Canonical標準網址操作指南,操作SEO不再苦惱www.awoo.ai · 2021-10-01T10:13:11+00:00 — Discusses: Do you still need to address duplicate pages after setting up canonical tags?
  4. Reviving Retired Search Console Reportswww.screamingfrog.co.uk · 2019-04-08T13:18:41+00:00 — Discusses: Should you investigate CSS or JavaScript that is blocked from search crawlers?
  5. Mastering SEO Audits: Unlocking Insights with the Screaming Frog SEO Spiderwww.screamingfrog.co.uk · 2023-10-18T10:42:49+00:00 — Source used in the article above.

Related articles

How can I tell whether an SEO tactic breaks spam rules?Should I rewrite or update an old article that does not rank?Will Reposting Social Content on My Website Cause a Duplicate-Content Penalty?What types of URLs are there, and what are they used for?What are the common mistakes, limitations, and costs of using subdomains?Can two URLs point to the same website?How to improve on-site content and structure: audit pages first, then address content gaps and internal linksHow can you use multiple domains to build content and traffic while assessing the risks?
ProcrustesPR
ProcrustesPR