1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to download basic website structure and page titles? What tool to use?

Discussion in 'White Hat SEO' started by hobnobsoldier, Jul 31, 2014.

  1. hobnobsoldier

    hobnobsoldier Newbie

    Joined:
    Feb 24, 2014
    Messages:
    12
    Likes Received:
    1
    How to download basic website structure and page titles? What tool to use?

    I know there are some Firefox plugins that do something similar, but I don't actually want to download the site content just the basic site structure and page titles would great...

    Any suggestions what I can use for this?

    Thanks
     
  2. nikiobicata

    nikiobicata Regular Member

    Joined:
    Mar 4, 2011
    Messages:
    443
    Likes Received:
    365
    Occupation:
    IT Director
    Location:
    New York
    Home Page:
    • Thanks Thanks x 1
  3. sirgold

    sirgold Supreme Member

    Joined:
    Jun 25, 2010
    Messages:
    1,260
    Likes Received:
    645
    Occupation:
    Busy proving the Pareto principle right
    Location:
    A hot one
    httrack will mirror the sites locally that's an excellent choice but if you're just a after a quick site structure / title scraping wget used with the recursive flag might be a better option...
     
    • Thanks Thanks x 1
  4. KHer0

    KHer0 Senior Member

    Joined:
    Mar 22, 2011
    Messages:
    876
    Likes Received:
    947
    Occupation:
    Architect
    • Thanks Thanks x 1
  5. hobnobsoldier

    hobnobsoldier Newbie

    Joined:
    Feb 24, 2014
    Messages:
    12
    Likes Received:
    1
    Guys thank you for the excellent advice. Much appreciated....trying all of these ideas :)
     
  6. AreYouReady

    AreYouReady Newbie

    Joined:
    Jul 26, 2014
    Messages:
    12
    Likes Received:
    1
    Are you looking to do serp comparisons per keyword for the ranking page?
     
  7. hobnobsoldier

    hobnobsoldier Newbie

    Joined:
    Feb 24, 2014
    Messages:
    12
    Likes Received:
    1
    I'm trying to figure out keywords for an existing (partially built) site that doesn't rank, so just need a way to extract various page URL's/Titles and then look for keywords from that info...
    It may be just as easy to do it manually, but wanted to see about an automated way of extracting the seed info.
     
    Last edited: Jul 31, 2014
  8. oxonbeef

    oxonbeef BANNED BANNED

    Joined:
    Jan 4, 2009
    Messages:
    2,242
    Likes Received:
    7,872
    Visual Seo Studio
    http://visual-seo.com
     
  9. Techxan

    Techxan Elite Member

    Joined:
    Dec 7, 2011
    Messages:
    3,093
    Likes Received:
    3,585
    Occupation:
    Local SEOist
    Location:
    TEXAS (you have to yell, its the law.)
    Free version of the Screaming Frog SEO spider.

    Essential tool for the SEO inclined.
     
  10. websemgem

    websemgem Newbie

    Joined:
    Feb 5, 2011
    Messages:
    20
    Likes Received:
    3
    XENU or A1 Website Analyzer (the latter can also extract top keywords of each page for you from titles, headers and content)
     
  11. mitchellpsmith

    mitchellpsmith Junior Member

    Joined:
    Jun 29, 2010
    Messages:
    114
    Likes Received:
    14
    Try XENU and Screaming Frog SEO spider, well it has the free version. They are good.