1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Request for tool that can scrape URL from text file

Discussion in 'Black Hat SEO Tools' started by mailcold, Jul 21, 2009.

  1. mailcold

    mailcold Newbie

    Joined:
    Jun 6, 2009
    Messages:
    17
    Likes Received:
    4
    Can someone direct me to a tool or script that can scrape all the URL from a plane .txt or .htm file. Each line of this file has many columns separated by say blank character and one of this column is URL.

    The input file is residing on my pc.

    The second tool I am looking for is the one that can harvest URLs from the results returned from a say a yahoo search.

    All Assistance will be appreciated with a press of thanks button.:p
     
    • Thanks Thanks x 1
  2. Subject

    Subject Power Member

    Joined:
    Dec 26, 2007
    Messages:
    656
    Likes Received:
    303
    Location:
    Living With Articles!!
    For the first thing, today I downloaded a url grabber thing... Its working, but not like I wanted.. I want clickable link in another file, but its output is urls in .txt format...

    Try this: guru's URL Grabber
    http://free.groupfetch.com/products/ugrab/index.php

    And funny I confused a bit using this.. Install the software, then in the File menu, selet Lload url List files, load the .html or .txt file. Then it will start working, after completion, go again to File Menu and select Save to File option.

    For the second thing, dont know...
    :p
     
    • Thanks Thanks x 1
  3. Choronzon

    Choronzon Power Member

    Joined:
    Apr 20, 2008
    Messages:
    559
    Likes Received:
    376
    I could write a tool that does that, I have seen a couple of people request it now so maybe there is a demand for it. Would take me about a day or so.
     
  4. mailcold

    mailcold Newbie

    Joined:
    Jun 6, 2009
    Messages:
    17
    Likes Received:
    4
    Thanks I will test this out.
     
  5. mailcold

    mailcold Newbie

    Joined:
    Jun 6, 2009
    Messages:
    17
    Likes Received:
    4
    Great, I would be looking forward to a tool with simple user interface.
    A search shows that there is a tool called Extract Link

    http://download.cnet.com/Extract-Link/3000-2369_4-10069721.html

    sold for 49.00 that does part1.
    The trial version can only save 5 extracted URLs. That is no good
     
  6. borntoleadinCPA

    borntoleadinCPA Regular Member

    Joined:
    Dec 11, 2008
    Messages:
    224
    Likes Received:
    243
    Anyone can give an idea *how much* would a tool like this COST?
     
  7. mailcold

    mailcold Newbie

    Joined:
    Jun 6, 2009
    Messages:
    17
    Likes Received:
    4
    After some more research here is the complete solution for part 1 of my original request which was

    Here is a tool that can scrape all the URL from a plane .txt or .htm file. Each line of this file has many columns separated by say blank character and one of this column is URL.

    Install instructions are as follows
    Unzip the file.
    Install the ExtractLink Application using ExtractLink-installer.exe
    once the application gets installed copy the file named ExtractLink.exe
    present in the directory copy-to-remove-limitation to the location where the program got installed.
    Enjoy
     

    Attached Files: