1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

sitemap tool needed

Discussion in 'Black Hat SEO Tools' started by Claudiu, May 12, 2011.

  1. Claudiu

    Claudiu Regular Member

    Joined:
    Feb 28, 2009
    Messages:
    288
    Likes Received:
    81
    Location:
    127.0.0.1
    hi,

    i'm looking for a tool that can generate a sitemap of other people's websites.

    the sitemap tool that i'm looking for should not try to connect to the pages, but just provide me the links to the website's pages.

    i need to skip the connectivity part and grab only the sitemap, as it takes to long for me to analyze the websites that way.

    your input would be appreciated
     
  2. remmaps

    remmaps Regular Member

    Joined:
    Apr 13, 2010
    Messages:
    212
    Likes Received:
    123
    Home Page:
    did you try with some of online generators like xml-sitemaps.com for example? you can download Sitemap in text file
     
    Last edited: May 12, 2011
  3. hunghtq

    hunghtq Registered Member

    Joined:
    Aug 24, 2010
    Messages:
    69
    Likes Received:
    8
  4. thetraveller

    thetraveller Senior Member

    Joined:
    Mar 9, 2009
    Messages:
    1,135
    Likes Received:
    705
    Occupation:
    thousandsmouseclicks
    Location:
    Eastern Europe
    I found sitemapdoc.com more stable, but still limited to 500 pages.
     
  5. Claudiu

    Claudiu Regular Member

    Joined:
    Feb 28, 2009
    Messages:
    288
    Likes Received:
    81
    Location:
    127.0.0.1
    yeah, 500 limit is also an issue ... i need to be able to crawl 50k
     
  6. Toples

    Toples Regular Member

    Joined:
    Apr 12, 2011
    Messages:
    344
    Likes Received:
    94
    Occupation:
    Industrial (mechanical) engineer
    Location:
    Zagreb, Croatia
    i think you will not find any free tool that will crawl 100k...
     
  7. Claudiu

    Claudiu Regular Member

    Joined:
    Feb 28, 2009
    Messages:
    288
    Likes Received:
    81
    Location:
    127.0.0.1
    well, not an online one .. (tho i know of one, issue with it is that it crawls for connectivity, which is something i need to be skipped as it takes to much time), but a dektop one will sure do. at least i hope so.

    if not a dektop one, maybe a php,asp, etc one
     
  8. Sven84

    Sven84 Newbie

    Joined:
    Apr 19, 2011
    Messages:
    16
    Likes Received:
    4
    If you know PHP, it's pretty easy to output a sitemap file with that. Plus, sitemap files are also limited to 50k urls.
     
  9. remmaps

    remmaps Regular Member

    Joined:
    Apr 13, 2010
    Messages:
    212
    Likes Received:
    123
    Home Page:
    gsitecrawler (dot) com

    you can export in txt. it is pretty fast
     
  10. llewopsnimajneb

    llewopsnimajneb Regular Member

    Joined:
    Jan 10, 2011
    Messages:
    242
    Likes Received:
    139
    Occupation:
    SEO, Affiliate marketer, Online marketing lecturer
    Location:
    Backwardstown