1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Indexing 30,000 Pages WH, suggestions?

Discussion in 'White Hat SEO' started by paytonlowe, Dec 29, 2010.

  1. paytonlowe

    paytonlowe Junior Member

    Joined:
    Dec 24, 2009
    Messages:
    180
    Likes Received:
    58
    Occupation:
    Internet marketer
    Location:
    Cyberspace
    Home Page:
    I bought a PR 2 domain and built and e-commerce site on it.

    The site has over 30,000 pages.

    I want to index all of the pages without doing any damage to the WH PR.

    Suggestions? Tips?
     
  2. christoss1959

    christoss1959 Senior Member

    Joined:
    Nov 25, 2010
    Messages:
    894
    Likes Received:
    1,150
    Home Page:
    Create a sitemap then use Google webmaster tools to submit your site map. You will need to verify ownership of your domain before you do so btw.
     
  3. HalfACalf

    HalfACalf Junior Member

    Joined:
    Sep 19, 2010
    Messages:
    155
    Likes Received:
    11
    Get ready to wait and wait and wait. I have a similar site where I submitted the sitemap 4 months ago and to date all of 634 pages have been indexed. The bots are sure taking their own sweet time! :(
     
  4. paytonlowe

    paytonlowe Junior Member

    Joined:
    Dec 24, 2009
    Messages:
    180
    Likes Received:
    58
    Occupation:
    Internet marketer
    Location:
    Cyberspace
    Home Page:
    DO you recomend a XML site map or HTML?
     
  5. HalfACalf

    HalfACalf Junior Member

    Joined:
    Sep 19, 2010
    Messages:
    155
    Likes Received:
    11
    Never use them. Straight .txt works 100%.
     
  6. paytonlowe

    paytonlowe Junior Member

    Joined:
    Dec 24, 2009
    Messages:
    180
    Likes Received:
    58
    Occupation:
    Internet marketer
    Location:
    Cyberspace
    Home Page:
    Could that explain the low ammount of indexing your experiencing?
     
  7. textosms

    textosms Newbie

    Joined:
    Dec 29, 2010
    Messages:
    8
    Likes Received:
    1
    sitemap.txt ?
    please help , i have same issue , i need to index 10 000 internal page : )
     
  8. paytonlowe

    paytonlowe Junior Member

    Joined:
    Dec 24, 2009
    Messages:
    180
    Likes Received:
    58
    Occupation:
    Internet marketer
    Location:
    Cyberspace
    Home Page:
    Ive never used it but I believe a sitemap.txt is just a text file with the list of urls to all pages on your site.

    Ive always used xml and html sitemaps, I might just make on of each to be safe.
     
  9. textosms

    textosms Newbie

    Joined:
    Dec 29, 2010
    Messages:
    8
    Likes Received:
    1
    hi paytonlowe
    How you do for sitemap.html , can you help ?

    i have already submited my sitemap.xml to google tool webmaster but there is just 3 link indexed by day from 10 000 link .

    Can you help me ?

    Thanks
     
  10. paytonlowe

    paytonlowe Junior Member

    Joined:
    Dec 24, 2009
    Messages:
    180
    Likes Received:
    58
    Occupation:
    Internet marketer
    Location:
    Cyberspace
    Home Page:
    An HTML sitemap is just a web page with links to every page on your site.

    If you can make an XML sitemap and HTML sitemap is a piece of cake!
     
  11. craigslistguy

    craigslistguy Regular Member

    Joined:
    Oct 24, 2010
    Messages:
    361
    Likes Received:
    112
    .txt sitemap? lol never heard of it

    Just make .xml sitemap and submit it..

    DL XML-Sitemap Wp plugin and it will do it for u
     
    • Thanks Thanks x 1
  12. .david.

    .david. Junior Member

    Joined:
    Jul 20, 2010
    Messages:
    197
    Likes Received:
    36
    Location:
    California

    That's what I'd do..
     
  13. HalfACalf

    HalfACalf Junior Member

    Joined:
    Sep 19, 2010
    Messages:
    155
    Likes Received:
    11
    Nah, the indexing works just as fast (or slow) on any type of sitemap. Just a good ol' plain .txt file is the fastest and easiest and most foolproof way to submit a big sitemap!

    From:

    http://www.google.com/support/webmasters/bin/answer.py?answer=183668#1

    Text file: You can provide Google with a simple text file that contains one URL per line. For example:
    http://www.example.com/file1.txt
    http://www.example.com/file2.txt

    For best results, follow these guidelines:

    You must fully specify URLs, as Google attempts to crawl them exactly as provided.
    The text file must use UTF-8 encoding.
    The text file should contain nothing but the list of URLs.
    You can name the text file anything you wish. Google recommends giving the file a .txt extension (for instance, sitemap.txt).