greyhatdude
Regular Member
- Sep 13, 2008
- 377
- 257
I blocked access to my WP site for about a week while I worked on it and I'm still not done with it, but I have finished all of the text/writing so I figured it would be okay for it to get crawled while I work on the multimedia content & social media integration - youtube vids, slideshare, facebook page, twitter feed, etc. This is the first time I've done a whitehat site (of my own) for a long time so I decided to try Joost De Valk's WP SEO plugin. I also pinged the site with Pingler and that was it. No linkwheel, no twitter mention, no directory ads, no senuke/xrumer/tweetattacks/bookmarking yet - crap - no fricking backlinks whatsoever (yet). And googlebot has been all over the site already, crawling it constantly since I pinged it. I'd like to know why, for future reference.
This is my statpress log - and yes, I have a sitemap/robots.txt, google analytics installed, a focus on a variety of longtail local (Baltimore) keywords (meta tags, bold keywords, 3% keyword saturation with several different but related words, other keywords in my RSS feeds, proper sentence length + keyword location, etc) --- but I've never seen googlebot behave like this. I might get one googlebot visit every day, but that's it. Any idea why this would happen? It's nice, it would be more useful on my other sites, but is it something everyone else sees often?
September 12, 2011 15: 12:11 Google /baltimore/-/feed Mozilla/5.0 (compatible; Googlebot/2.1;
September 12, 2011 15: 11:55 Google /baltimore/featured/feed Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 51:06 Google /baltimore-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 49:29 Google /baltimore-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 46:39 Google /-.../feed/atom Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 46:27 Google /-...... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 44:26 Google /baltimore... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 43:28 Google /keyword-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 43:15 Google Page: Home Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 43:01 Google /baltimore/-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 42:55 Google /author/-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 42:18 Google /baltimore/featured Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 11:11 Google /baltimore/-.../feed Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 10:32 Google /comments/feed Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 09:47 Google /baltimore... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 09:46 Google /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 09:19 Google /baltimore-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 08:46 Google /baltimore... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 08:38 Google /-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 11: 14:49 Google /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +
This is my statpress log - and yes, I have a sitemap/robots.txt, google analytics installed, a focus on a variety of longtail local (Baltimore) keywords (meta tags, bold keywords, 3% keyword saturation with several different but related words, other keywords in my RSS feeds, proper sentence length + keyword location, etc) --- but I've never seen googlebot behave like this. I might get one googlebot visit every day, but that's it. Any idea why this would happen? It's nice, it would be more useful on my other sites, but is it something everyone else sees often?
September 12, 2011 15: 12:11 Google /baltimore/-/feed Mozilla/5.0 (compatible; Googlebot/2.1;
September 12, 2011 15: 11:55 Google /baltimore/featured/feed Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 51:06 Google /baltimore-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 49:29 Google /baltimore-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 46:39 Google /-.../feed/atom Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 46:27 Google /-...... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 44:26 Google /baltimore... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 43:28 Google /keyword-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 43:15 Google Page: Home Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 43:01 Google /baltimore/-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 42:55 Google /author/-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 13: 42:18 Google /baltimore/featured Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 11:11 Google /baltimore/-.../feed Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 10:32 Google /comments/feed Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 09:47 Google /baltimore... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 09:46 Google /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 09:19 Google /baltimore-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 08:46 Google /baltimore... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 12: 08:38 Google /-... Mozilla/5.0 (compatible; Googlebot/2.1; +
September 12, 2011 11: 14:49 Google /robots.txt Mozilla/5.0 (compatible; Googlebot/2.1; +
Last edited: