1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How do I get my indexing blogs crawled more regular?

Discussion in 'Black Hat SEO' started by Ranko Jones, Oct 5, 2011.

  1. Ranko Jones

    Ranko Jones BANNED BANNED

    Joined:
    Mar 3, 2011
    Messages:
    1,677
    Likes Received:
    146
    Also what is a good crawl rate? Currently they're at like 50 per day but they aren't indexing for shit.

    I had an old one which isn't working any more either but when it was it used to get like 400-600 crawls p/d IIRC.

    Now SB causes a short spike in spiders but it's just that, a very short spike then they drop rapidly again.

    How do I get the bots coming in high rates on a consistent basis?

    I've done all the usual bullcrap- sb blasting, ping, rss, bmarking. Even the feeds were good quality but still didn't seem to make a diff.
     
  2. hamd01

    hamd01 Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 29, 2010
    Messages:
    560
    Likes Received:
    127
    You havent tried the obvious thing which Google actually wants.... posting regular unique (quality unspun) articles on a regular basis.

    Post one article per week, and after each post monitor how long it takes the articles to be indexed. Over time you can reduce the amount of time between posting articles....in no time at all you should have them indexing within minutes!
     
  3. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    1. unique content, regularly update
    2. high pr links
    3. hence increase your pr = more regular crawls
     
  4. Ranko Jones

    Ranko Jones BANNED BANNED

    Joined:
    Mar 3, 2011
    Messages:
    1,677
    Likes Received:
    146
    Hmm, in terms of 'unique content' I could just write and mish mash of garbage, wouldn't have to be legible would it since it's only for G bot to discern as 'unique'.
     
  5. theforceof1

    theforceof1 Junior Member

    Joined:
    Feb 13, 2008
    Messages:
    100
    Likes Received:
    19
    try the webmaster, post unique content and don't need to to do the bullcrap just grab some attention from twitter or digg or reddit and you are there in google index.
     
  6. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    as long as it is grammatically correct, then who cares what you talk about. talk about joe jonas and taylor swift relationship if you want, but nothing adult/viagra of course :)
     
  7. phuningenji

    phuningenji Junior Member

    Joined:
    Oct 1, 2008
    Messages:
    152
    Likes Received:
    22
    Occupation:
    Student
    Location:
    New York
    I've noticed that high post frequency and/or high traffic increase the crawl rate.
     
  8. Ranko Jones

    Ranko Jones BANNED BANNED

    Joined:
    Mar 3, 2011
    Messages:
    1,677
    Likes Received:
    146
    Hmm does it even have to be grammatically correct?
     
  9. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    If you want high indexation, high crawling, respect for your pages from the SEs, yes. If you want the algos to think its another spam blog, then go ahead, post any crap. Depends if you want your links indexed or not I guess.