1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Google bot won't crawl my site

Discussion in 'White Hat SEO' started by tygrus, Jul 16, 2010.

  1. tygrus

    tygrus Supreme Member

    Joined:
    Mar 28, 2009
    Messages:
    1,237
    Likes Received:
    827
    Occupation:
    Engineer
    Location:
    Canada
    I updated my xml site map in wordpress which notified google automatically, then I submitted the site url to google as well and then bookmarked the main domain, yet still the bot won't come to crawl the site, therefore my adsense has bogus ads.

    How else can I make that stupid bot get over and crawl that site?
     
  2. bizroot

    bizroot Supreme Member

    Joined:
    Feb 25, 2008
    Messages:
    1,345
    Likes Received:
    912
    Location:
    In My Computer
    When you started your site... Sometimes it could take few days before getting indexed... Some times it happens in few minutes and some times it goes for few days so no need to panic... Keep doing basic promotion and it will crawl your site... BTW check robots.txt if there is any problem? You can use robots.txt and sitemap validator to check if there is any error... Get few good back links
     
  3. bizilux

    bizilux Senior Member

    Joined:
    Apr 19, 2009
    Messages:
    896
    Likes Received:
    231
    Occupation:
    IM
    Location:
    slovenia
    haha...wordpress.... its on default that ur blog is on private, so it blocks engines, just check under options tab

    atleast that was few months ago when i was using it
     
  4. metalfreek

    metalfreek Junior Member

    Joined:
    May 21, 2010
    Messages:
    139
    Likes Received:
    58
    Yes this is right. When you install wordpress its privacy setting is to prevent bots form crawling. Go to your privacy setting and change the setting.
     
  5. tygrus

    tygrus Supreme Member

    Joined:
    Mar 28, 2009
    Messages:
    1,237
    Likes Received:
    827
    Occupation:
    Engineer
    Location:
    Canada
    Nope, privacy option was changed to allow bots, so that can't be it.
     
  6. BassTrackerBoats

    BassTrackerBoats Moderator Staff Member Moderator Jr. VIP

    Joined:
    Mar 10, 2010
    Messages:
    12,766
    Likes Received:
    21,995
    Occupation:
    I don't actually have a job
    Location:
    It's an Algo, of course it can be gamed.
    Home Page: