Not indexing by Googlebot..... already 7days passed after ping

Yes i have allowed googlebot in this way:

useragent:googlebot
Allow:/

Is that a correct way?

I think you've miswritten "useragent".

But why not just allow it all for all bots and users, and then disallow what you don't want indexed i.e. you can do like this:
User-agent: *
Disallow: /admin/
 
I think the indexing rate is also tied in to how competetive the niche is. If there are a million people trying to rank for those keywords they are going to be a bit slower about crawling every site. I actually just made a thread about abou the subject. You can find it here:

http://www.blackhatworld.com/blackh...rs-one-hundred-uniques-day-within-1-week.html

my keyword has 7600 real competitors.I checked thkeyword using intitle and inurl and also checked using traffic travis and stealth keyword
 
I think the indexing rate is also tied in to how competetive the niche is.

I'm pretty sure it isn't. I've launched sites about pop music, dogs, football, betting, lottery, loanes. All being able to index very quickly.

Ranking, however, is another matter.
 
as I recently asked plussing a site with google plus will probably get the site indexed have a go at that
 
If you're not indexed after 2 weeks the domain may have been black listed because of a previous owner.

You should also check your domain in the waybackmachine to see if it's had a previous owner.

OP is right. I had same problem and my site was never indexed by G. Normally WP website gets indexed in not more than a week, normally 2/3 days, so more than a week not being indexed pretty much means sandbox.

The only solution is to request your site for reconsideration at G, but make sure content is good, otherwise they will reject your request.

In order to request a site for reconsideration follow the steps in this link:
http://www.google.com/support/webmasters/bin/answer.py?answer=35843
 
I just let G find my new stuff on its own.

Anyway, here's some code that you can use to know when the Gbot visits your site:

PHP:
 <!-- Googlebot alert -->
<?
function simpleMailSend($from, $to, $subj, $text)
{
$un        = strtoupper(uniqid(time()));
$head      = "From: $from\n";
$head     .= "Subject: $subj\n";
$head     .= "Reply-To: $from\n";
$head     .= "Mime-Version: 1.0\n";
$head     .= "Content-Type:multipart/mixed;";
$head     .= "boundary=\"----------".$un."\"\n\n";
$zag       = "------------".$un."\nContent-Type:text/html;\n";
$zag      .= "Content-Transfer-Encoding: 8bit\n\n$text\n\n";

if (!@mail("$to", "$subj", $zag, $head))
return false;
else
return true;
}
if(eregi("googlebot",$_SERVER['HTTP_USER_AGENT'])) {
  $s = "";
  foreach($_SERVER as $item => $value) {
    $s .= "\n$item : $value";
  }
  $sdate = date("Y-m-d h:i:s");
  $message = <<<MESSAGE
Visit date:$sdate
Information:
=================================
$s
=================================
MESSAGE;

    simpleMailSend("[email protected]", "[email protected]",  "googlebot alert", "your site has just been visited");
}?> <!-- End of Googlebot alert -->
The 1st set of quotes is the 'from' address I think, the 2nd is the address to send to I think, the 3rd is the subject line of the email, the 4th is the body of the email.

That looks nice, where should i paste this?
 
Just type this: User-agent: *

in your robots.txt. The reason is you blocked google from indexing your site.

And check your privacy settings in your wordpress backend. Enable that searchengins can crawl your blog.
 
Just type this: User-agent: *

in your robots.txt. The reason is you blocked google from indexing your site.

And check your privacy settings in your wordpress backend. Enable that searchengins can crawl your blog.


All are OK according to you.But still now no result.I am going to mad with this site.Where is the problem i am not understanding
 
I have 6 article in my this site.Each article is around 350-600 words and 3-5% keyword density with H1 and h2 tag.Articles are well written by myself.But i have used around 8 youtube video which are not of me.Is that a problem?

I have tested my robot.txt file using google webmaster tools and result is:



Allowed by line 395: Allow:/
Detected as a directory; specific files may have different restrictions
 
Last edited:
I imagine you coul just add it to the index file through ftp.

You could add it to the footer, but then you'd get an email every time any page on the site gets visited, I imagine just the index page would be enough.

I've added to wp sites before, but forget where I added it, probably as I wrote above, just to the index file.

Someone more up on wp could say for sure.

Also, I've read that you need to be careful when adding to things to 'robot.txt' and such. Maybe try just deleting everything from that file and see what happens. If it then visits, you could add it back and then see what happens.
 
First Bad Experience in my short SEO life.Today google indexed my site.But indexed all the unknown pages.I used a social plugin named by Sexy bookmarks.Goole indexed 29 links of my site but all are this style:

Code:
www.mysite.com/wp-content/plugins/sexybookmarks/js/
I am not sure how these links have.Google did not index my main articles but indexed these hidden links.So that i have deleted all data from cpanel of this site and thinking to start with fully new content.Bad experience but needed to learn something more.So i can tell ........

"Thank You Mr. Google"
 
Last edited:
Guys try Bulkping.com now for indexing ... weve added new personal engines and procees is dripfeeded too for slow pinging ..
 
Back
Top