1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

List of URL's - how to extract Title

Discussion in 'Black Hat SEO Tools' started by OzGold, Jun 2, 2011.

  1. OzGold

    OzGold Registered Member

    Joined:
    May 30, 2011
    Messages:
    57
    Likes Received:
    11
    I have a list of around 500,000 urls and I want to extract the page title from each oif them. I thought Xenu did this but the titles it's returning seem to be the anchor text used in the link in the html file where i have these urls stored.

    Anyone have any other ideas or another tool?

    Thanks
     
  2. OzGold

    OzGold Registered Member

    Joined:
    May 30, 2011
    Messages:
    57
    Likes Received:
    11
    OK I'll give $25 to anyone who can whip up a script (if that's not breaking the rules!) - I would have thought it's 10 mins work if you know what you're doing! So to be clear:

    1) I have a list of URLs in a .txt doc
    2) I need a script that accesses each URL and returns the page title
    3) No need for proxies and doesn't have to be super fast

    Thanks!
     
  3. mark0v

    mark0v Junior Member

    Joined:
    May 6, 2010
    Messages:
    114
    Likes Received:
    20
    I can write a PHP script to do that for you, you'd need to run it on a LAMP server.