1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Any Ideas for indexing 25K+ page site?

Discussion in 'Black Hat SEO' started by conrulez, May 2, 2013.

  1. conrulez

    conrulez Power Member

    Joined:
    Dec 29, 2009
    Messages:
    513
    Likes Received:
    407
    Gender:
    Male
    Location:
    USA
    Hello everyone,
    I need some help and input on how to overcome this issue. I have a wordpess site with well over 25K posts. I can't for the life of me seem to get hardly any of it indexed though. Currently there are less than 400 pages indexed. It has been about 6 weeks now since I launched it. Google visits every day but only crawls maybe 50 pages and doesn't seem to index but maybe 10 of them if that. This is a silo site too. And yes, I do have a sitemap that G has crawled.

    I have thrown some quality links at it as well as some high end bookmarks and quality web 2.0's that had decent tiered links to them too. No matter what I can't seem to get google to start crawling and indexing 1000's of pages. I have not seen this in the past with similar sites. Usually by week 3 or 4 a site this big would have 10K+ pages indexed and sometimes many more. It clearly would be crawled like mad by google.

    Any ideas on what's up here or a possible solution to kickstart googlebot?

    Thanks for the help,
    Con
     
  2. Zul MOO

    Zul MOO Registered Member

    Joined:
    Apr 6, 2013
    Messages:
    69
    Likes Received:
    39
    Occupation:
    Analyst and part time IMer
    Location:
    Malaysia
    Home Page:
    • Thanks Thanks x 1
  3. the_demon

    the_demon Jr. Executive VIP

    Joined:
    Nov 23, 2008
    Messages:
    3,177
    Likes Received:
    1,563
    Occupation:
    Search Engine Marketing
    Location:
    The Internet
    One quick and relatively simple approach would be to use scrapebox to scrape your site map, export to text file, and then run the url list through lindexed.
     
    • Thanks Thanks x 2
  4. aseohosting

    aseohosting Newbie

    Joined:
    Feb 19, 2013
    Messages:
    43
    Likes Received:
    6
    Home Page:
    You could check the server logs to see exactly what the googlebot is doing when it visits and see if it's getting lost or stuck somewhere.
     
    • Thanks Thanks x 1
  5. omnipotent$

    omnipotent$ Regular Member

    Joined:
    Mar 23, 2013
    Messages:
    493
    Likes Received:
    288
    Just use the site:yourdomainname.com in scrapebox and then blast all the pages of the site with links.