These settings serve different purposes: nofollow addresses link endorsement, while noindex addresses whether a page is included in the search index. If a news aggregation site does not want to endorse a particular news source, it can consider adding nofollow to that link. If it does not want one of its own aggregation pages to appear in search results, it can consider using noindex on that page. A link should not automatically receive nofollow simply because it points to another site, nor can noindex replace a nofollow setting on an external link.
Are you setting an attribute on a link or a directive for your own page?
A rel=”nofollow” attribute on an individual link and a page’s noindex setting apply to different things. For example, suppose a news roundup page lists ten reports. If one source has not been verified and the editor does not want to endorse it, the editor can consider nofollow for that link. Whether the entire roundup page should appear in search results is a separate decision.
Semrush explains that noindex can be used to exclude specific pages from the index, such as internal search results pages or test pages. On your own news aggregation page, it applies to that page; it does not determine whether another outlet’s original report is indexed. The cited material also mentions page-level meta nofollow. This differs from setting nofollow on individual links and should not be confused with it.
The sources disagree on whether external links should use nofollow
Two posts on Warrior Forum argue that nofollow should be used when aggregating news headlines or linking externally. However, the cited Stack Exchange answer does not support applying it across the board. It focuses on whether you can endorse the source and whether the link has been reviewed, not simply whether the link points to your own site or another one. When curating news, these distinctions can guide individual decisions:
- Editorially selected reports you are willing to endorse: The fact that a link is external is not, by itself, a reason it must use nofollow.
- Unreviewed sources or sources you do not want to endorse: The cited discussion suggests considering nofollow; the link can still provide readers with additional information.
- Paid or exchanged links: The cited discussion identifies these as types requiring special treatment, but those comments should not be treated as a complete account of current official link-attribute guidelines.
Consider noindex when you want to keep a page out of search results
Suppose an internal news search results page is intended only for site visitors and you do not want it to appear in search results. You can consider using noindex on that page rather than setting all its news links to nofollow. Semrush also cautions that blocking crawling alone does not keep a URL out of search results: if other pages link to it, it may still appear in the results.
Likewise, nofollow should not be treated as a shortcut for retaining your site’s ranking equity. The cited Stack Exchange answer argues against using it to sculpt PageRank and states that doing so does not retain extra ranking equity on your site. These discussions support making separate decisions about link endorsement and page indexing; they do not establish that news aggregation necessarily brings substantial traffic or that using noindex preserves page authority.
External links and indexing on news aggregation sites: perspectives from across the web
Will leaving an aggregation page out of the sitemap prevent it from being indexed?
Not on its own. The cited discussion treats a sitemap as a suggestion and noindex as a directive to exclude a page from the index. Semrush also cautions that even if crawling is blocked, a URL may still appear in search results if other pages link to it. If the goal is to exclude a particular aggregation page, consider using noindex on that page.
Can visitors still use an aggregation page after it is set to noindex?
Yes. A forum post notes that a page set to noindex remains available to site visitors. The setting affects search indexing; it does not remove the page from the site. If a page is intended only for existing visitors and you do not want it to appear in search results, you can consider using noindex. However, the available material does not provide enough evidence to support the post's separate claim that page authority is unaffected by content.
Can a page be excluded from the index while still allowing search engines to follow its links?
Yes. The cited material lists the combination of noindex and follow: noindex indicates that the page should not be indexed, while follow allows search engines to follow links on the page. Depending on your needs, noindex can also be combined with page-level nofollow. However, these settings do not guarantee that linked pages will or will not be crawled.
References
- Will many links to the same page without nofollow penalize the host site in the search engine rankings?webmasters.stackexchange.com — Source used in the article above.
- Should I nofollow/noindex the outgoing links in a news aggregator website?www.warriorforum.com — Discusses: Can visitors still use an aggregation page after it is set to noindex?
- What is technical SEO? Basics and best practiceswww.semrush.com · 2023-02-01T15:56:00Z — Discusses: Will leaving an aggregation page out of the sitemap prevent it from being indexed?; Can visitors still use an aggregation page after it is set to noindex?
- robots.txt、meta robots設定:讓網頁不被Google搜尋到www.yesharris.com · 2024-08-15T14:20:11+08:00 — Discusses: Can a page be excluded from the index while still allowing search engines to follow its links?
- 網站連結優化怎麼做?網站動線優化+內部連結 4 大重點welly.tw · 2022-03-28T02:40:10.969Z — Source used in the article above.
- How to handle hundred of external links in a site?webmasters.stackexchange.com — Source used in the article above.
- How to handle hundred of external links in a site?webmasters.stackexchange.com — Source used in the article above.
- Sitemap vs nofollowwebmasters.stackexchange.com — Source used in the article above.
- Should I nofollow/noindex the outgoing links in a news aggregator website?www.warriorforum.com — Source used in the article above.
- Gaining back page rank and seach engine rankingwebmasters.stackexchange.com — Source used in the article above.
- Sitemap vs nofollowwebmasters.stackexchange.com — Discusses: Will leaving an aggregation page out of the sitemap prevent it from being indexed?



