Googlebot is all OVER my site after one day - why?

greyhatdude

Regular Member
Joined
Sep 13, 2008
Messages
377
Reaction score
257
I blocked access to my WP site for about a week while I worked on it and I'm still not done with it, but I have finished all of the text/writing so I figured it would be okay for it to get crawled while I work on the multimedia content & social media integration - youtube vids, slideshare, facebook page, twitter feed, etc. This is the first time I've done a whitehat site (of my own) for a long time so I decided to try Joost De Valk's WP SEO plugin. I also pinged the site with Pingler and that was it. No linkwheel, no twitter mention, no directory ads, no senuke/xrumer/tweetattacks/bookmarking yet - crap - no fricking backlinks whatsoever (yet). And googlebot has been all over the site already, crawling it constantly since I pinged it. I'd like to know why, for future reference.

This is my statpress log - and yes, I have a sitemap/robots.txt, google analytics installed, a focus on a variety of longtail local (Baltimore) keywords (meta tags, bold keywords, 3% keyword saturation with several different but related words, other keywords in my RSS feeds, proper sentence length + keyword location, etc) --- but I've never seen googlebot behave like this. I might get one googlebot visit every day, but that's it. Any idea why this would happen? It's nice, it would be more useful on my other sites, but is it something everyone else sees often?

September 12, 2011 15: 12:11 Google /baltimore/-/feed Mozilla/5.0 (compatible; Googlebot/2.1;
September 12, 2011 15: 11:55 Google /baltimore/featured/feed Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 51:06 Google /baltimore-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 49:29 Google /baltimore-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 46:39 Google /-.../feed/atom Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 46:27 Google /-...... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 44:26 Google /baltimore... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 43:28 Google /keyword-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 43:15 Google Page: Home Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 43:01 Google /baltimore/-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 42:55 Google /author/-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 42:18 Google /baltimore/featured Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 11:11 Google /baltimore/-.../feed Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 10:32 Google /comments/feed Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 09:47 Google /baltimore... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 09:46 Google /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 09:19 Google /baltimore-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 08:46 Google /baltimore... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 08:38 Google /-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 11: 14:49 Google /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +
 
Last edited:
For me this is not unusual at all, usually I have about 60 google bot visits the second day after I create a site.

And even though it might seem unusual I don't see any disadvantages with googlebot scanning the entire site and hopefully indexing it.
 
Thats normal dont panic it is the way it is.

Dizz
 
so how's the WP SEO plugin working for you? I know there were some bugs that he fixed so just seeing if it's worth switching over to from Platinum SEO
 
Thats normal dont panic it is the way it is.

Dizz

No panic, just curiosity since it's new to me. It's my first geo- focused site and also my first brand new site since Panda.

Sent from my SPH-D700 using Tapatalk
 
so how's the WP SEO plugin working for you? I know there were some bugs that he fixed so just seeing if it's worth switching over to from Platinum SEO

I've always used all-in-one seo. This is a vast improvement, much more refined. I think its similar to platinum seo but has a bit more features regarding rss feeds, if I remember platinum seo correctly.

Sent from my SPH-D700 using Tapatalk
 
For me this is not unusual at all, usually I have about 60 google bot visits the second day after I create a site.

And even though it might seem unusual I don't see any disadvantages with googlebot scanning the entire site and hopefully indexing it.

Good to know. That's the info I was looking for.

Sent from my SPH-D700 using Tapatalk
 
That nice.

I made a new template (custom html) for my website yesterday (with new style of autoblog content). I checked today i have 618 pages indexed. Pretty shocking experience for me.
 
Back
Top