Google indexing

559 articles

Troubleshoot crawling, indexing, robots directives and canonicals when pages are missing from search.

ProcrustesPR
Should you enable image directory indexing so search engines can discover images?

You do not need to enable directory indexing for /images/ solely to help search engines discover images. The available sources indicate that a directory…

Why conduct an SEO audit, and how should you get started?

An SEO audit helps you understand a website’s search performance, identify technical and content issues that may hinder rankings, and decide where to focus…

Why Check for Search Console Errors?

Checking for Search Console errors helps you determine whether Google can find, read, and index your website’s content. It also helps you identify issues…

Why use an XML sitemap, and which websites benefit from one?

An XML sitemap gives search engines a list of important URLs, offering another way to discover content besides following links. Not every website needs one.…

Why keep some pages out of the search index, and which pages are suitable for exclusion?

Some pages need to remain on a website but are not suitable entry points from search. Reasons for excluding them from the index may include keeping…

ProcrustesPRProcrustesPRProcrustesPRUnder what circumstances might backlinks affect rankings?
Links open normally, but Webmaster Tools reports 500 errors: how can you verify and troubleshoot them?

A link that opens now may not have worked when a search engine crawled it earlier. A 500 error in Webmaster Tools may reflect a server error encountered…

Why prefer slash-separated paths to query-string URLs? Consider the purpose and site setup first

Slash-separated paths are often preferred because they make URLs easier to read and type and show a clear content hierarchy—not because query strings…

What Is the Difference Between Orphan Pages and Dead-End Pages?

The difference between orphan pages and dead-end pages is the direction of the missing links: an orphan page has no links pointing to it from other pages on…

How to validate and scale Schema implementation: validate one page first, then roll out in batches

Validating Schema involves more than checking formatting: first confirm that the markup accurately reflects the page, then check its syntax, eligibility for…

How can you minimize the harm a website redesign does to SEO?

To minimize the harm a website redesign does to SEO, focus on preserving the URLs and important content of pages that already rank. When URLs must change,…

How can you prevent images or images with specific file extensions from being indexed?

To prevent images from appearing in Google search results, you can use robots.txt to block image URLs or set rules based on file extensions. You can also…

What should you do with test URLs after testing ends? First clarify their purpose and redirect direction

Once testing ends, check what the URL is used for, whether it has been publicly accessible, and whether it is still needed. Do not automatically redirect it…

ProcrustesPRProcrustesPRProcrustesPRWhat risks remain with large numbers of links, even from topically relevant websites?
When traffic drops, how can you distinguish between manual actions, algorithmic filtering, and core updates?

A traffic drop does not necessarily mean a penalty. Start by checking Search Console for manual action notifications. Then review when traffic fell and…

How to choose and specify a canonical URL: canonical settings for multiple URLs with the same content

When multiple URLs provide identical or very similar content, first choose the URL you want users to see in search results. Then point the duplicate…

How can you identify and handle duplicate URLs and decide which indexing directives to use?

Before addressing duplicate URLs, decide what you want indexed: should search results use a particular primary URL, or should a page be excluded from the…

Should Search Results and Tag Pages Be Blocked? First Clarify Your Crawling and Indexing Goals

Search results and tag pages should not all be blocked with robots.txt by default. If the goal is to reduce crawler access to large numbers of problematic…

How do you check, diagnose, and improve SEO for a JavaScript website?

When checking SEO for a JavaScript website, first confirm whether search engines can access important content after rendering, then investigate crawl…

How can on-page optimization and sitewide technical improvements work together?

On-page optimization and sitewide technical improvements should work together to make content easy to understand and help search engines find and access it.…

Does Republishing the Same Article on Other Sites Affect the Original Site’s SEO? A Link to the Original Is No Ranking Guarantee

Republishing the same article on multiple sites may affect the original article’s visibility in search, but it does not automatically mean the original site…

ProcrustesPRProcrustesPRProcrustesPRUsing Web 2.0 Sites for SEO: Content Exposure and the Effects and Risks of Link Manipulation
What are the requirements for image sitemaps, and how do you troubleshoot problems?

When checking an image sitemap, start with the image namespace, required tags, the number of images per page URL, cross-domain hosting, and robots.txt…

Why does image SEO matter, and what are its opportunities and limitations for search visibility?

Image SEO makes images easier for search engines to find and understand, giving images and the pages they appear on more opportunities to show up in organic…

Which websites need a Google News Sitemap, and what should you watch out for?

A Google News Sitemap is primarily suited to news publishers, media outlets, and news websites that publish timely news and meet Google News content…

Which website architecture factors may affect rankings?

Website architecture factors that may affect rankings include crawler access, page loading performance, content and language markup, URL and navigation…

Which URL structures can cause crawling problems, and how can they be fixed?

URL structures that can cause crawling problems include large numbers of similar URLs generated by multiple filters and unnecessary parameters, endlessly…

What can cause the wrong canonical URL to be selected?

An unexpected canonical URL may result from misconfigured CMS settings or plugins, server hosting errors, a hacked website, or missing language and region…