1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Site with 1000's of pages..how can I easily generate a list of each page's URLs to Ping?

Discussion in 'White Hat SEO' started by kboxer7, Aug 14, 2010.

  1. kboxer7

    kboxer7 Jr. VIP Jr. VIP Premium Member

    Joined:
    Jan 25, 2010
    Messages:
    872
    Likes Received:
    700
    I am building directory style sites that are quite large from databases, then outsorcing unique content/descriptions to each page making them unique from others who may use the databases.

    My question is how I can easily generate a list of ALL the URLs for my site so I can submit them/ping them to get indexed faster?

    Thank you BHW!!!!
     
  2. rprabu

    rprabu Power Member

    Joined:
    Feb 11, 2009
    Messages:
    580
    Likes Received:
    261
    Location:
    Home :-)
    If all your pages are indexed you can use scrapebox to harvest all your site urls.. and then can ping with it..
     
  3. AutoBlogger

    AutoBlogger Power Member

    Joined:
    Oct 20, 2009
    Messages:
    780
    Likes Received:
    928
    Occupation:
    IM, AutoBlogging and Urban Planning
    Location:
    The Global Village
    Make a sitemap and scrape url from sitemap page.
     
  4. kboxer7

    kboxer7 Jr. VIP Jr. VIP Premium Member

    Joined:
    Jan 25, 2010
    Messages:
    872
    Likes Received:
    700
    It is for a new site that of which not that many pages are indexed. In the past, I have had a hard time getting all (or a large portion) of the pages indexed/crawled. I"m hoping to overcome this by adding unique content to the database pages, as well as PINGing and proper internal linking structure.

    So for a site that is not yet indexed, what is the best way to do this?

    Thank you for the responses thus far!!!
     
  5. zdmas

    zdmas Registered Member

    Joined:
    Aug 15, 2010
    Messages:
    74
    Likes Received:
    1
    Home Page:
    If they are all interlinked somehow, you can find a Sitemap generator program that will index all the URL's and automatically create a .xml sitemap file that you can submit to Google Webmaster.
     
  6. seotap

    seotap Newbie

    Joined:
    Aug 15, 2010
    Messages:
    1
    Likes Received:
    0
    Visit OPTIMUMSEO. NET They have a program that can generate and manage up to 100,000 landing pages. It's Awesome!