Checking internal links in programmatic content involves more than confirming that links exist. You also need to check whether crawlers can follow them, whether the number generated exceeds what the content needs, and whether important pages receive more links. First, confirm that the links can be crawled, then examine how categories and metadata generate pages and links in bulk. Next, filter crawl results for links in the content area and check their distribution. Finally, use structural diagrams to identify anomalies worth investigating. The articles discussed below provide no universal limit on link counts, so a high count alone does not establish a problem.
First, confirm that programmatically generated links can be followed
If internal links are generated through JavaScript, the first step is to confirm that crawlers can access and follow them to understand the site’s structure. A 2023 article on Neil Patel’s website notes that Google Search Console’s URL Inspection tool can show how Google renders a page, while crawling the site with Screaming Frog can help identify JavaScript-related issues.
This check applies when JavaScript is used to generate links. Programmatic content does not necessarily use this approach, so the two should not be treated as equivalent.
Identify which fields are driving link growth
In Screaming Frog’s 2023 case study, the author created categories using around 40 wine reviews and metadata such as wineries, regions, grape varieties, and tasting notes. This added 300 pages and 7,000 internal links to a site that previously had around 700 pages. The issue was not just the increase in pages: each appearance of a wine also generated links to some or all of its category terms.
- Check which data fields automatically create category pages.
- Check whether category links are generated repeatedly when the same content appears in different lists.
- Assess whether these links are necessary in relation to the amount of content and the site’s priorities.
The author believed this expansion could shift the site’s topical focus and would not help increase revenue. That was a judgment about this case, not proof that the same cause and effect would apply generally. The author then reduced the number of tasting notes used to generate links while retaining all the terms in the review text.
Filter for links in the content area and check their distribution
Following the example in that 2023 article, select all URLs in Screaming Frog’s upper Internal tab, then inspect Inlinks below and limit the display to links in the Content area. Next, filter for the target directory, such as wine-reviews, in the Links tab. Examine how links are distributed and whether important pages receive more links.
After the author streamlined the links, the 210 wine review pages had around 1,000 links, but this is not a recommended number. Focus on whether link quality and quantity reflect the importance of the content, rather than copying the ratio in the case study.
Use structural diagrams as an additional check, not as a verdict
The article also recommends using the Force-directed Directory Tree Diagram under Visualizations to examine the directory structure of large numbers of programmatic pages. Loose clusters can offer clues for further investigation, but the diagram alone cannot establish that something is wrong.
If the site makes extensive use of in-page links, such as those in tables of contents, consider disabling Crawl Fragment Identifiers. This changes whether fragment identifiers are crawled; it does not mean removing in-page links from the site.
Internal links in programmatic content: perspectives from across the web
Do automatically generated pages still need their internal links checked if canonical and noindex are already set?
Yes. Those settings do not establish that internal link quality is adequate. In Screaming Frog's 2023 article, the author had another set of automatically generated pages that contained large numbers of internal links despite having canonical and noindex set. The author believed these pages still had potential if the user experience and the data flow used to generate them were improved, and some links were streamlined. This assessment was specific to that set of pages.
References
- Definitive Javascript SEO Guideneilpatel.com · 2023-09-14T19:00:00+00:00 — Source used in the article above.
- Using Screaming Frog to Improve Programmatic SEO Contentwww.screamingfrog.co.uk · 2023-06-22T10:54:32+00:00 — Discusses: Do automatically generated pages still need their internal links checked if canonical and noindex are already set?

