1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Help Needed - Indexing Massive Site - 450,000 pages of content

Discussion in 'Black Hat SEO' started by addbravo2, Jul 4, 2013.

  1. addbravo2

    addbravo2 Newbie

    Joined:
    Oct 29, 2012
    Messages:
    15
    Likes Received:
    0
    Hey there,


    I have created a dynamic yellow pages - business directory portal with over 450,000 pages and business listings of content. I have submitted xml sitemaps to google webmaster tools a few weeks ago. Still, only 11000 pages are indexed till now. Anything I can do to help accelerate the indexing rate (besides linking and submitting the site to various static sites)

    Thanks ;)
     
  2. n3wbseo

    n3wbseo Junior Member

    Joined:
    Mar 22, 2011
    Messages:
    117
    Likes Received:
    23
    if its a new domain or a new sub domain i find google indexes about 2000 pages a day of dupe content. could be faster for not dupe content. submitting xml sitemap is the way to do it just sit back and let the google machine do its thing. might help if your site stays static at this time.
     
  3. xpleet

    xpleet Regular Member

    Joined:
    Jan 18, 2010
    Messages:
    377
    Likes Received:
    327
    Location:
    Morocco
    If you the domain is new, beware of publishing too much pages at once. You can have trouble with google and you may be sandboxed or penalized.
    Try to publish less than 1000 pages per day.
     
  4. n3wbseo

    n3wbseo Junior Member

    Joined:
    Mar 22, 2011
    Messages:
    117
    Likes Received:
    23
    im positive hundreds of million+ page websites go online almost every day monday to friday and have been for the last year with no ill effects.
     
  5. mktanny

    mktanny Regular Member

    Joined:
    Oct 22, 2009
    Messages:
    225
    Likes Received:
    62
    Occupation:
    Blog editor and IM
    If I were you , i would probably drip feed all the dynamic pages (say 100 new pages each day) and dynamically add them to the sitemap.

    Also one good thing to do is , keep few (if not all) of the new pages published today on the homepage for that day only and then swap them with the new pages the next day (it will all be dynamic of course) -- all that does is , makes your site look more natural and builds up slowly (not exactly though) , so that you can create backlinks to the pages you think might be good for your readers (inclusive of search engines).

    Ones the site takes off , increase the number of pages published each day gradually or randomize according to the day of the week/month/year.
     
  6. innozemec

    innozemec Jr. VIP Jr. VIP

    Joined:
    Aug 19, 2011
    Messages:
    5,288
    Likes Received:
    1,799
    Location:
    www.Indexification.com
    Home Page:
    Yeah, best would be not to publish all pages at once, but on daily portions..

    If you published them already, try submitting sitemaps to G, pinging each page multiple times and it will still take time to index most of the pages, they all will not be indexed