To identify thin content, focus on whether a page answers readers’ questions. To identify duplicate content, check whether different URLs provide identical or nearly identical information. A low word count, identical titles, or a page not being indexed are clues to investigate, not conclusive evidence on their own. Depending on each page’s purpose, consider expanding the content, merging pages and redirecting URLs, or using canonical URLs and noindex settings, rather than deleting every similar page.
Thin content is not necessarily short—it lacks the answers readers need
Screaming Frog’s 2023 article describes thin content as pages that lack substantive information and fail to answer users’ questions. Forum contributor dave_hermansen also suggests that length should depend on what the topic requires: explaining how to boil water naturally takes a different amount of text than discussing how to turn water into fuel. This is advice for evaluating content, not a search engine word-count rule.
- An e-commerce category page has no products in stock and lacks useful information.
- A supporting page for a topic has been created but does not yet contain the intended information.
- An affiliate marketing page merely copies merchant information without explaining why a product is or is not worth buying.
These situations warrant priority review, but each page still needs to be read individually. Screaming Frog’s 2023 tutorial describes using a low-content filter or sorting by word count to identify pages for review. Its default threshold is fewer than 200 words and can be adjusted; it is not a minimum standard for Chinese-language articles.
At Procrustes, we turn the questions our clients genuinely care about into articles, with ongoing content planning, writing, and updates.
Check both the main content and URLs for duplication
Duplication does not necessarily result from plagiarism. Neil Patel’s 2022 article lists tracking parameters, session IDs, print versions, and different paths generated by content management systems as possible reasons the same content may appear at multiple URLs. A 2023 example from Screaming Frog notes that simply reversing the order of the same pair of products in a comparison leaves the information almost identical, even if it may serve readers arriving through different entry points.
- On-site checks: Screaming Frog’s tutorial describes using exact-duplicate and near-duplicate filters to find pages, then comparing their main content in detail. Duplicate titles, H1s, and H2s can also be flagged for review.
- Off-site checks: Search for several excerpts of two to three sentences each, or use plagiarism detection tools to find matching text.
Semrush’s 2023 article suggests starting with Search Console reports of unindexed pages, but says only that template-based pages may have duplication issues. A page not being indexed is therefore not proof of duplicate content.
Decide whether to keep a page before choosing how to handle it
Drawing on recommendations from 2021 to 2023, start by distinguishing three situations:
- The page needs to remain separate: Add genuinely distinct information, such as criteria for making a purchase decision, rather than simply restating the merchant’s description.
- A separate URL is no longer needed: Consider merging the content and using a permanent 301 redirect to a page you are keeping on a related topic. Avoid redirect loops.
- Multiple versions of the same content are still needed: Consider using canonical tags to indicate the preferred URL; noindex may also be an option for print versions.
awoo’s 2021 explanation notes that canonical tags provide a signal for search engines to consider, not a guarantee that the specified version will be selected. These settings can help handle duplicate versions, but they cannot replace the substantive content a page should contain.
Thin and duplicate content: perspectives from across the web
How much duplicate content is too much for a website?
The articles cited here do not specify a fixed acceptable percentage. Neil Patel’s 2022 article argues that occasional duplicate content does not necessarily lead to a search ranking penalty, but reducing unnecessary duplication or mitigating its effects is still worthwhile. Screaming Frog’s 2023 article cautions that similar pages may dilute each other’s ability to rank for the same keyword. Focus on why duplication occurs and what each page is for, rather than merely calculating a percentage.
If every article needs a disclaimer, how can you reduce duplication?
If every article includes a lengthy, identical boilerplate disclaimer in its main content, consider keeping a shorter version in each article and linking to a full policy page. Neil Patel’s 2022 article notes that repeated disclaimers in the main content may be considered duplicate content. However, whether they can be shortened still depends on their practical purpose; necessary information should not be removed solely to avoid duplication.
Can internal links replace repeatedly writing the same content?
For related topics, organized internal links can guide readers to existing content and reduce the need to repeat the same information. Welly’s 2022 article cautions that this approach still depends on the website having substantial, distinct content. If the linked pages themselves lack information or are too similar, linking them to one another alone will not improve the reading experience.
How can you reduce duplication caused by URL formatting?
Check whether URL parameters and slashes are used consistently across the site, and clean up internal links pointing to duplicate versions. Forum advice suggests that reducing these URL variations can lower the chance of crawlers repeatedly fetching the same content. Which versions should be retained still depends on the content each URL actually provides and its purpose.
References
- Accepting Guest Posts with no-follow links - Is this bad for SEO?www.warriorforum.com — Source used in the article above.
- Duplicate Content: 5 Myths and 5 Facts About How It Impacts SEOneilpatel.com · 2022-02-22T21:00:00+00:00 — Discusses: How much duplicate content is too much for a website?; If every article needs a disclaimer, how can you reduce duplication?
- Conducting an SEO Content Audit: 6 Things You Might Be Overlookingwww.screamingfrog.co.uk · 2021-11-15T13:37:48+00:00 — Source used in the article above.
- 網站連結優化怎麼做?網站動線優化+內部連結 4 大重點welly.tw · 2022-03-28T02:40:10.969Z — Discusses: Can internal links replace repeatedly writing the same content?
- Using Screaming Frog to Improve Programmatic SEO Contentwww.screamingfrog.co.uk · 2023-06-22T10:54:32+00:00 — Discusses: How much duplicate content is too much for a website?
- Canonical標準網址操作指南,操作SEO不再苦惱www.awoo.ai · 2021-10-01T10:13:11+00:00 — Source used in the article above.
- Franchise SEO: How to Optimize for Local Search Resultswww.semrush.com · 2023-09-20T10:40:00Z — Source used in the article above.
- SEO: How do I get 1 million pages indexed?www.warriorforum.com — Discusses: How can you reduce duplication caused by URL formatting?

