1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Question: Google bot

Discussion in 'Black Hat SEO' started by kismet10, Aug 16, 2009.

  1. kismet10

    kismet10 Newbie

    Joined:
    Jun 22, 2009
    Messages:
    31
    Likes Received:
    0
    My site is finally indexed by G However, the googlebot disallows search. I want it to appear in SERPs.. but the crawler blocks it. What do I need to do???
    Thanks!
     
  2. keinehabe

    keinehabe Supreme Member

    Joined:
    Nov 4, 2008
    Messages:
    1,207
    Likes Received:
    472
    Gender:
    Male
    Occupation:
    -= CEO =-
    Location:
    Heaven
    Home Page:
    you lost me .... :) your site it's indexed or not ? if is indexed will appear on the serps if no of course will not appear . crawler's can't block you nowhere , they will just crawl / read your pages , then MAY BE will get indexed that's all :)
     
  3. keinehabe

    keinehabe Supreme Member

    Joined:
    Nov 4, 2008
    Messages:
    1,207
    Likes Received:
    472
    Gender:
    Male
    Occupation:
    -= CEO =-
    Location:
    Heaven
    Home Page:
    you lost me .... :) your site it's indexed or not ? if is indexed will appear on the serps if no of course will not appear . crawler's can't block you nowhere , they will just crawl / read your pages , then MAY BE will get indexed that's all :)
     
  4. kismet10

    kismet10 Newbie

    Joined:
    Jun 22, 2009
    Messages:
    31
    Likes Received:
    0
    Hmm coz when I checked goog webmsters tools.. It said that it is indexed. However, when i search for my domain in serps.. it didnt appear.....

    and when i checked my robots.txt, it says
    User-agent: Mediapartners-Google
    Disallow:

    User-agent: *
    Disallow: /search
     
  5. ruler0fall

    ruler0fall Power Member

    Joined:
    May 17, 2009
    Messages:
    565
    Likes Received:
    263
    your robots.txt looks fine don't know what the problem is. Doesn't it give some more detail ?
     
  6. kismet10

    kismet10 Newbie

    Joined:
    Jun 22, 2009
    Messages:
    31
    Likes Received:
    0
    what to do what to do.... i need it to be included in serps....
    whats the point of being indexed if cant be searched !
     
  7. kismet10

    kismet10 Newbie

    Joined:
    Jun 22, 2009
    Messages:
    31
    Likes Received:
    0
    @ruler

    User-agent: Mediapartners-Google
    Disallow:

    User-agent: *
    Disallow: /search


    what does this mean?
     
  8. Djingel

    Djingel Junior Member

    Joined:
    Apr 9, 2007
    Messages:
    150
    Likes Received:
    84
    wait for a day or 2, could be your getting your results for another server, don't worry...

    robots.txt

    - This means that for some reason you don't want the adsense bot access your page. (I personally wouldn't do that)
    - see post under this one
     
    Last edited: Aug 17, 2009
  9. ruler0fall

    ruler0fall Power Member

    Joined:
    May 17, 2009
    Messages:
    565
    Likes Received:
    263
    I checked it means bot with user agent Mediapartners-Google can access anything, and any user agent can't access /search, ofcourse only robots. Try swapping them so the google one is at the bottom.
     
    • Thanks Thanks x 1
  10. kismet10

    kismet10 Newbie

    Joined:
    Jun 22, 2009
    Messages:
    31
    Likes Received:
    0
    thanks @ djingel
    thanks also @ rulerfall

    ill try doing some changes
    thanks
     
  11. ruler0fall

    ruler0fall Power Member

    Joined:
    May 17, 2009
    Messages:
    565
    Likes Received:
    263
    There's a button for that ;)
    I'll keep an eye on this thread to see how it works out.