1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Tool for scraping sitemaps from multiple domains?

Discussion in 'Black Hat SEO Tools' started by seeplusplus, Aug 10, 2011.

  1. seeplusplus

    seeplusplus Power Member

    Joined:
    Aug 18, 2008
    Messages:
    511
    Likes Received:
    163
    I have a list of around 200 domains which I need to scrape a sitemap from.

    Is there anything which can so this?

    I've been using online sitemap generators, but this taking wayyy too long. I really would like to be able to copy and paste all the domains into a program, let it run overnight and get the sitemaps in the morning.

    I don't have links to the site's sitemap, many do not have them at all.

    Hope someone can help. Thanks.
     
    Last edited: Aug 10, 2011
  2. other_henry

    other_henry Junior Member

    Joined:
    Jun 1, 2011
    Messages:
    107
    Likes Received:
    19
    Occupation:
    Freelance coder, server guy
    Location:
    US
    You mention both sitemap generators and scraping which is confusing.

    Are you trying to:

    a. create sitemaps for your domains?

    b. get sitemaps from other people's domains?

    c. both?
     
  3. balas

    balas Registered Member

    Joined:
    Feb 9, 2009
    Messages:
    62
    Likes Received:
    4
    Occupation:
    seo specialist
    Location:
    .pl
    Home Page:
    Its quite old thread, but I am looking for the similar software. For me it is option B - "get sitemaps from other people's domains"

    Any advice?