How can I increase the crawl rate of my site in Google?
 by Casey Markee

How can I increase the crawl rate of my site in Google?

  • When comparing my site to some of my competitors I notice that my site is crawled less frequently. I know that this metric is relatively important for SEO, and would like to increase my average crawl rate. What can I do to get the Googlebot to revisit my pages more often?

Answer: You are correct in thinking that regular and frequent crawling of your site by Google is a relatively important SEO metric. In fact, it's one of THE most important metrics that site owners can identify in knowing that their site and its content truly appeals to Google. Sites and pages that Google views as more important and relevant are visited more often; if you're seeing a slower rate of revisits as compared to your competitors, it's definitely a metric that you should attempt to improve.

Even though there's really no way to "force" search engine spiders or crawlers to visit your site more frequently, there are ways to stack the odds in your favor that can result in more frequent deep crawls of your site's content—such as:

  1. Add your site to Google Webmasters Tools. Doing this will provide you resources you can use to monitor how your site is performing in the Google index. This includes seeing which pages may be unreachable and adjusting them accordingly.
  2. Adjust the crawl speed of your site in Google Webmasters Tools. This is a simple step you can implement immediately. This new crawl rate will be valid for 90-days and is a great starting point. Here is information from Google support on how to implement the crawl frequency change.
  3. Update your site content more frequently. Google likes fresh content and if you can't update your site daily, shoot for three times a week if possible to ensure optimal crawling.
  4. Add automatic pinging to your blog. If you have a blog and are experiencing ...

Already a member? Sign in here

Read the rest of this article,
and get all this for only $1.

  • The Search Engine Strategies Updates for October 2016
  • Ultimate Guide to Avoiding Google Penalties
  • The Complete Site Audit Checklist
  • The Definitive Local Search Audit Checklist
  • 100's of Strategic SEO Articles and Q&As
  • The Professional Engine Master's Chart
  • The Internet Marketing Glossary
  • The Ultimate Directory Submission List
  • The Pro SEO's Local Search Directory List
  • 16 years of SEN Archives
  • PLUS, as a Full SEN Basic Member, you'll be eligible for hundreds of dollars of discounts on SEO courses ranging from beginner to master on a variety of topics including organic search, local search, and social networking.

  • Your $1 Trial is good for 7 days at which time your card will be charged $29/mo unless you cancel before October 8th, 2016

 This form is encrypted for your security