What are the effects and limitations of indexing and preview rules?

ProcrustesPR

Indexing and link rules control whether resources can appear in search results and whether links are followed; preview rules control how much text, imagery, and video can be shown. The two should not be confused. According to the supplied Google documentation, noindex, nofollow, and the various preview limits serve different purposes. Some rules have exceptions for embedded content or separately authorized uses. The comparison below applies to Google; other search engines may handle these rules differently.

ProcrustesPRProcrustesPRWhich sources are useful for following SEO news and trends?

Indexing and links: separate controls

  • all: By default, there are no restrictions on indexing or snippets. Explicitly adding this rule has no additional effect.
  • noindex: Do not display the page, media, or resource in search results. nofollow: Do not follow links on the page. none is equivalent to using both.
  • indexifembedded: Must be used with noindex. When content is embedded in other pages through an iframe or similar HTML element, Google may still index the embedded content.
  • noimageindex: Do not index images on the page. This differs from rules that limit image preview sizes.

Snippets and previews: text, images, and video

nosnippet prohibits text snippets and video previews and prevents content from being used as direct input for AI Overviews and AI Mode. However, static thumbnails may still appear if they improve the user experience, so this does not mean all images will disappear.

  • max-snippet: Limits text snippets by the number of half-width characters and also limits the amount of content used as direct input for AI Overviews and AI Mode. It generally does not affect image or video previews. A value of 0 is equivalent to nosnippet, while -1 lets Google choose the snippet length.
  • max-image-preview: none prevents image previews, standard allows previews at the default size, and large allows larger images, up to the width of the viewport.
  • max-video-preview: Limits video snippets in seconds. A value of 0 allows at most one static image, subject to the image preview settings; -1 sets no limit.

If Google cannot parse the numeric value set for max-snippet or max-video-preview, it ignores that rule. Text snippet and image preview restrictions also do not apply to uses separately authorized by the publisher. The documentation lists uses authorized through structured data or licensing agreements as examples.

Translation and expiration: what each rule controls

notranslate prevents search results from offering a translation of the page. Without this setting, Google may translate the title link and snippet.

unavailable_after prevents the page from appearing in search results after a specified date and time. Googlebot will also substantially reduce how often it crawls the URL. The date and time must be valid, for example in ISO 8601 format; otherwise, Google ignores the rule. By default, there is no expiration date.

Combining settings and recognizing obsolete rules

Rules can be specified through a robots meta tag or X-Robots-Tag and are case-insensitive. When rules conflict, the more restrictive one applies. For example, if max-snippet:50 and nosnippet are used together, nosnippet takes precedence. To allow text snippets of up to 20 half-width characters and larger image previews, combine max-snippet:20 with max-image-preview:large.

noarchive, nocache, and nositelinkssearchbox are all ignored by Google Search. Cached links and the sitelinks search box no longer exist, so the related legacy rules should no longer be treated as effective controls.

ProcrustesPRProcrustesPRHow does Google personalized search work, and what can it be used for?

Indexing and preview rules: perspectives from across the web

How can I prevent Google from displaying a page while still allowing its embedded content to be indexed?

Use noindex together with indexifembedded. The former instructs Google not to display the page in search results; the latter allows Google to index the embedded content when it appears on other pages through an iframe or similar HTML element. indexifembedded only takes effect when paired with noindex; it cannot be used on its own.

Do I also have to disable all images to prevent video previews?

Not necessarily. max-video-preview:0 allows at most one static image as a video preview, subject to the max-image-preview setting. nosnippet prohibits both text snippets and video previews, but Google may still display a static thumbnail if it improves the user experience. The key difference is that max-video-preview:0 only limits video previews, while nosnippet also prohibits text snippets.

Can limiting text snippet length also limit image and video previews?

Generally, no. When its numeric value can be parsed, max-snippet limits text snippet length and the amount of content that can be used as direct input for AI Overviews and AI Mode. Image and video previews must be controlled separately using max-image-preview and max-video-preview. However, max-snippet:0 is equivalent to nosnippet and also prohibits video previews. Separately authorized uses are not subject to the text snippet limit.

Can the old cache and sitelinks search box rules still control Google search results?

No. According to the supplied Google documentation, noarchive, nocache, and nositelinkssearchbox are all ignored by Google Search, so they can no longer control cached links or the sitelinks search box in Google search results. The documentation states that both features no longer exist. Other search engines may handle these rules differently, so this does not establish how the rules work elsewhere.

ProcrustesPRHow does Google personalization change how information and search results are presented?

References

  1. 漫遊器中繼標記規格 | Google 搜尋中心  |  Documentation  |  Google for Developersdevelopers.google.com — Discusses: How can I prevent Google from displaying a page while still allowing its embedded content to be indexed?; Do I also have to disable all images to prevent video previews?

Related articles

Which sources are useful for following SEO news and trends?How does Google personalized search work, and what can it be used for?How does Google personalization change how information and search results are presented?How are search intent, brands, and query length related?What problems could arise when AI cites AI-generated content?How can you limit content appearing in Google Search?How Long Does It Take to Evaluate SEO Results?Where should I start if I want to do SEO myself?
ProcrustesPR
ProcrustesPR