202009 Mar
Crawled — Currently Not Indexed: A Coverage Status Guide
General News

One of the benefits of working at an agency is being able to get in front of a lot of data, and because we’ve seen this message across multiple accounts, we’ve begun to pick up on trends from reported URLs. When spot-checking individual pages that are listed in the report, a common problem we see across clients is URLs that contain text noting “expired” or “out of stock” products. If this is occurring on a large number of URLs, it is worth taking steps to send stronger consolidation signals to Google. If Google isn’t indexing a large amount of this content, you might consider adjusting your robots.txt file to block crawling immediately. I would highly encourage search marketers to get familiar with the data and reports as we routinely find suboptimal crawling and indexing behavior, especially on larger sites.

  • Sales and Marketing
  • Lead Management Software
  • Online Marketing
  • Search, Information retrieval and - extraction
  • Content & Web Management
  • Data Management and Acquisition
  • Security
  • Virus Protection Software