Tool for scraping sitemaps from multiple domains?

Discussion in 'Black Hat SEO Tools' started by seeplusplus, Aug 10, 2011.

  1. seeplusplus

    seeplusplus Power Member

    Joined:
    Aug 18, 2008
    Messages:
    520
    Likes Received:
    167
    I have a list of around 200 domains which I need to scrape a sitemap from.

    Is there anything which can so this?

    I've been using online sitemap generators, but this taking wayyy too long. I really would like to be able to copy and paste all the domains into a program, let it run overnight and get the sitemaps in the morning.

    I don't have links to the site's sitemap, many do not have them at all.

    Hope someone can help. Thanks.
     
    Last edited: Aug 10, 2011
  2. other_henry

    other_henry Junior Member

    Joined:
    Jun 1, 2011
    Messages:
    107
    Likes Received:
    19
    Occupation:
    Freelance coder, server guy
    Location:
    US
    You mention both sitemap generators and scraping which is confusing.

    Are you trying to:

    a. create sitemaps for your domains?

    b. get sitemaps from other people's domains?

    c. both?
     
  3. balas

    balas Registered Member

    Joined:
    Feb 9, 2009
    Messages:
    64
    Likes Received:
    4
    Occupation:
    seo specialist
    Location:
    .pl
    Home Page:
    Its quite old thread, but I am looking for the similar software. For me it is option B - "get sitemaps from other people's domains"

    Any advice?