Question: Google bot

K

kismet10

Newbie

Jun 22, 2009

30

0

• Aug 16, 2009

• #1

My site is finally indexed by G However, the googlebot disallows search. I want it to appear in SERPs.. but the crawler blocks it. What do I need to do???
Thanks!

 

keinehabe

Supreme Member

Nov 4, 2008

1,207

476

• Aug 16, 2009

• #2

you lost me .... your site it's indexed or not ? if is indexed will appear on the serps if no of course will not appear . crawler's can't block you nowhere , they will just crawl / read your pages , then MAY BE will get indexed that's all

 

keinehabe

Supreme Member

Nov 4, 2008

1,207

476

• Aug 16, 2009

• #3

you lost me .... your site it's indexed or not ? if is indexed will appear on the serps if no of course will not appear . crawler's can't block you nowhere , they will just crawl / read your pages , then MAY BE will get indexed that's all

 

K

kismet10

Newbie

Jun 22, 2009

30

0

• Aug 17, 2009
• Thread Starter Thread Starter

• #4

Hmm coz when I checked goog webmsters tools.. It said that it is indexed. However, when i search for my domain in serps.. it didnt appear.....

and when i checked my robots.txt, it says
User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search

 

R

ruler0fall

Power Member

May 17, 2009

560

267

• Aug 17, 2009

• #5

your robots.txt looks fine don't know what the problem is. Doesn't it give some more detail ?

 

K

kismet10

Newbie

Jun 22, 2009

30

0

• Aug 17, 2009
• Thread Starter Thread Starter

• #6

what to do what to do.... i need it to be included in serps....
whats the point of being indexed if cant be searched !

 

K

kismet10

Newbie

Jun 22, 2009

30

0

• Aug 17, 2009
• Thread Starter Thread Starter

• #7

@ruler

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search


what does this mean?

 

Djingel

Junior Member

Apr 9, 2007

150

110

• Aug 17, 2009

• #8

wait for a day or 2, could be your getting your results for another server, don't worry...

robots.txt

- This means that for some reason you don't want the adsense bot access your page. (I personally wouldn't do that)
- see post under this one

 

Last edited: Aug 17, 2009

R

ruler0fall

Power Member

May 17, 2009

560

267

• Aug 17, 2009

• #9

kismet10 said:

@ruler

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search


what does this mean?

Click to expand...

I checked it means bot with user agent Mediapartners-Google can access anything, and any user agent can't access /search, ofcourse only robots. Try swapping them so the google one is at the bottom.

 

K

kismet10

Newbie

Jun 22, 2009

30

0

• Aug 17, 2009
• Thread Starter Thread Starter

• #10

thanks @ djingel
thanks also @ rulerfall

ill try doing some changes
thanks

 

R

ruler0fall

Power Member

May 17, 2009

560

267

• Aug 17, 2009

• #11

There's a button for that
I'll keep an eye on this thread to see how it works out.