Not indexing by Googlebot..... already 7days passed after ping

Royalserviceteam · Jul 10, 2011

CoolAdvisor said:
Do you have robots.txt on your site? Maybe you blocked googlebot from indexing your pages?

Yes i have allowed googlebot in this way:

useragent:googlebot
Allow:/

Is that a correct way?

pleasenukeme · Jul 10, 2011

Royalserviceteam said:
Yes i have allowed googlebot in this way:

useragent:googlebot
Allow:/

Is that a correct way?

I think you've miswritten "useragent".

But why not just allow it all for all bots and users, and then disallow what you don't want indexed i.e. you can do like this:
User-agent: *
Disallow: /admin/

adbot · Jul 10, 2011

I think the indexing rate is also tied in to how competetive the niche is. If there are a million people trying to rank for those keywords they are going to be a bit slower about crawling every site. I actually just made a thread about abou the subject. You can find it here:

http://www.blackhatworld.com/blackh...rs-one-hundred-uniques-day-within-1-week.html

Royalserviceteam · Jul 10, 2011

adbot said:
I think the indexing rate is also tied in to how competetive the niche is. If there are a million people trying to rank for those keywords they are going to be a bit slower about crawling every site. I actually just made a thread about abou the subject. You can find it here:

http://www.blackhatworld.com/blackh...rs-one-hundred-uniques-day-within-1-week.html

my keyword has 7600 real competitors.I checked thkeyword using intitle and inurl and also checked using traffic travis and stealth keyword

pleasenukeme · Jul 11, 2011

adbot said:
I think the indexing rate is also tied in to how competetive the niche is.

I'm pretty sure it isn't. I've launched sites about pop music, dogs, football, betting, lottery, loanes. All being able to index very quickly.

Ranking, however, is another matter.

tomaso88 · Jul 11, 2011

as I recently asked plussing a site with google plus will probably get the site indexed have a go at that

todor · Jul 11, 2011

TK421 said:
If you're not indexed after 2 weeks the domain may have been black listed because of a previous owner.

You should also check your domain in the waybackmachine to see if it's had a previous owner.

OP is right. I had same problem and my site was never indexed by G. Normally WP website gets indexed in not more than a week, normally 2/3 days, so more than a week not being indexed pretty much means sandbox.

The only solution is to request your site for reconsideration at G, but make sure content is good, otherwise they will reject your request.

In order to request a site for reconsideration follow the steps in this link:
http://www.google.com/support/webmasters/bin/answer.py?answer=35843

spoon22 · Jul 11, 2011

Viltedali said:

I just let G find my new stuff on its own.

Anyway, here's some code that you can use to know when the Gbot visits your site:

PHP:

 <!-- Googlebot alert -->
<?
function simpleMailSend($from, $to, $subj, $text)
{
$un        = strtoupper(uniqid(time()));
$head      = "From: $from\n";
$head     .= "Subject: $subj\n";
$head     .= "Reply-To: $from\n";
$head     .= "Mime-Version: 1.0\n";
$head     .= "Content-Type:multipart/mixed;";
$head     .= "boundary=\"----------".$un."\"\n\n";
$zag       = "------------".$un."\nContent-Type:text/html;\n";
$zag      .= "Content-Transfer-Encoding: 8bit\n\n$text\n\n";

if (!@mail("$to", "$subj", $zag, $head))
return false;
else
return true;
}
if(eregi("googlebot",$_SERVER['HTTP_USER_AGENT'])) {
  $s = "";
  foreach($_SERVER as $item => $value) {
    $s .= "\n$item : $value";
  }
  $sdate = date("Y-m-d h:i:s");
  $message = <<<MESSAGE
Visit date:$sdate
Information:
=================================
$s
=================================
MESSAGE;

    simpleMailSend("[email protected]", "[email protected]",  "googlebot alert", "your site has just been visited");
}?> <!-- End of Googlebot alert -->

The 1st set of quotes is the 'from' address I think, the 2nd is the address to send to I think, the 3rd is the subject line of the email, the 4th is the body of the email.

That looks nice, where should i paste this?

spoon22 · Jul 11, 2011

Just type this: User-agent: *

in your robots.txt. The reason is you blocked google from indexing your site.

And check your privacy settings in your wordpress backend. Enable that searchengins can crawl your blog.

Royalserviceteam · Jul 11, 2011

spoon22 said:
Just type this: User-agent: *

in your robots.txt. The reason is you blocked google from indexing your site.

And check your privacy settings in your wordpress backend. Enable that searchengins can crawl your blog.

All are OK according to you.But still now no result.I am going to mad with this site.Where is the problem i am not understanding

Royalserviceteam · Jul 11, 2011

I have 6 article in my this site.Each article is around 350-600 words and 3-5% keyword density with H1 and h2 tag.Articles are well written by myself.But i have used around 8 youtube video which are not of me.Is that a problem?

I have tested my robot.txt file using google webmaster tools and result is:

Allowed by line 395: Allow:/
Detected as a directory; specific files may have different restrictions

Viltedali · Jul 11, 2011

I imagine you coul just add it to the index file through ftp.

You could add it to the footer, but then you'd get an email every time any page on the site gets visited, I imagine just the index page would be enough.

I've added to wp sites before, but forget where I added it, probably as I wrote above, just to the index file.

Someone more up on wp could say for sure.

Also, I've read that you need to be careful when adding to things to 'robot.txt' and such. Maybe try just deleting everything from that file and see what happens. If it then visits, you could add it back and then see what happens.

Royalserviceteam · Jul 14, 2011

First Bad Experience in my short SEO life.Today google indexed my site.But indexed all the unknown pages.I used a social plugin named by Sexy bookmarks.Goole indexed 29 links of my site but all are this style:

Code:

www.mysite.com/wp-content/plugins/sexybookmarks/js/

I am not sure how these links have.Google did not index my main articles but indexed these hidden links.So that i have deleted all data from cpanel of this site and thinking to start with fully new content.Bad experience but needed to learn something more.So i can tell ........

"Thank You Mr. Google"

johnfun · Apr 3, 2012

Guys try Bulkping.com now for indexing ... weve added new personal engines and procees is dripfeeded too for slow pinging ..

Not indexing by Googlebot..... already 7days passed after ping

Royalserviceteam

Power Member

pleasenukeme

Junior Member

adbot

Power Member

Royalserviceteam

Power Member

pleasenukeme

Junior Member

tomaso88

Registered Member

todor

Regular Member

spoon22

Regular Member

spoon22

Regular Member

Royalserviceteam

Power Member

Royalserviceteam

Power Member

Viltedali

Regular Member

Royalserviceteam

Power Member

johnfun

Junior Member

Main Menu

Marketplace

Making Money

BlackHat World