1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

No spider crawl my blog but why?

Discussion in 'Blogging' started by Dark Knight, Nov 30, 2009.

  1. Dark Knight

    Dark Knight Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 15, 2009
    Messages:
    731
    Likes Received:
    1,194
    Hello
    I thought might be something wrong in my robots txt
    its looks
    User-agent: *
    Disallow:

    Sitemap: http://www.domainname.com/sitemap.xml.gz

    can any one tell my why not spider crawl my blog ???:hurt:
     
  2. Remington

    Remington Regular Member

    Joined:
    Feb 27, 2009
    Messages:
    305
    Likes Received:
    148
    Check the privacy settings in Wordpress (assuming it's WP). The latest version has it set to NOT be crawled by default.
     
  3. Dark Knight

    Dark Knight Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 15, 2009
    Messages:
    731
    Likes Received:
    1,194
    well thanks for your reply
    here is the pic [​IMG]
    do you think this is oky?
     
  4. Kingfresh

    Kingfresh Regular Member

    Joined:
    Jul 8, 2009
    Messages:
    374
    Likes Received:
    295
    is your site listed in google? Search with site:yourdomain.com

    and try google webmastertools /analytics , add your site there maybe that should work!
     
  5. unnamed

    unnamed Junior Member

    Joined:
    May 4, 2008
    Messages:
    176
    Likes Received:
    50
    Location:
    EU shithole
    definitely its ok, but try to build some more backlinks
     
  6. Dark Knight

    Dark Knight Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 15, 2009
    Messages:
    731
    Likes Received:
    1,194
    yes my site listed in google but no spider coming I don't know why :(