scraping urls from text file by keyword

Discussion in 'Black Hat SEO Tools' started by oneill, Nov 22, 2011.

  1. oneill

    oneill Registered Member

    Joined:
    Oct 2, 2010
    Messages:
    54
    Likes Received:
    9
    Hi,

    I have a text document with 1000+ links like this one govmp .com/user.php?login=okanmokan99&view=history and i need a scraper or something to extract the actual urls from submissions based on keywords.

    Like i import the list then type the keyword "erken rezervasyon" and the tool to extract the urls that are with that keyword.

    Please someone help me to find good software. I spend all day long trying to find something good.

    thank you
     
  2. Nitros

    Nitros Power Member

    Joined:
    Jan 30, 2009
    Messages:
    580
    Likes Received:
    298
    I can use ubot for this task.
     
  3. oneill

    oneill Registered Member

    Joined:
    Oct 2, 2010
    Messages:
    54
    Likes Received:
    9
    any idea where i can get that?
     
  4. Nitros

    Nitros Power Member

    Joined:
    Jan 30, 2009
    Messages:
    580
    Likes Received:
    298
  5. oneill

    oneill Registered Member

    Joined:
    Oct 2, 2010
    Messages:
    54
    Likes Received:
    9
    any other tool ?
     
  6. kokoloko75

    kokoloko75 Elite Member

    Joined:
    Jan 1, 2011
    Messages:
    1,628
    Likes Received:
    1,943
    Occupation:
    Design director
    Location:
    Paris (France)
    Try to put your file on Localhost (local server) and use classic tools.

    Beny
     
  7. schwagoo

    schwagoo Senior Member

    Joined:
    Nov 8, 2010
    Messages:
    807
    Likes Received:
    737
    Location:
    Midwest, USA
    you do NOT want to buy uBot just for this. ubot has a fairly steep learning curve and it would be a terrible waste of money to buy it for this.

    Post up in the freelancer section. A decent PHP programmer should be able to make you a custom script for this in less than an hour. Put a $20 price tag on it and I bet someone will make it for you right away.
     
  8. luminus

    luminus Junior Member

    Joined:
    Oct 21, 2008
    Messages:
    112
    Likes Received:
    32
    Occupation:
    Operations, UBot Studio
    Location:
    Virtually Anywhere
    Home Page:
    Not to just push ubot, as I'd agree you could outsource this much easier, but if you're going to do it a lot or do other tasks like this, you'd save money in the long run with a Standard license. But only if you've got other stuff to apply it to!



     
  9. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    Spadix Extract Link will do that.