1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

scraping urls from text file by keyword

Discussion in 'Black Hat SEO Tools' started by oneill, Nov 22, 2011.

  1. oneill

    oneill Registered Member

    Joined:
    Oct 2, 2010
    Messages:
    52
    Likes Received:
    9
    Hi,

    I have a text document with 1000+ links like this one govmp .com/user.php?login=okanmokan99&view=history and i need a scraper or something to extract the actual urls from submissions based on keywords.

    Like i import the list then type the keyword "erken rezervasyon" and the tool to extract the urls that are with that keyword.

    Please someone help me to find good software. I spend all day long trying to find something good.

    thank you
     
  2. Nitros

    Nitros Power Member

    Joined:
    Jan 30, 2009
    Messages:
    573
    Likes Received:
    295
    I can use ubot for this task.
     
  3. oneill

    oneill Registered Member

    Joined:
    Oct 2, 2010
    Messages:
    52
    Likes Received:
    9
    any idea where i can get that?
     
  4. Nitros

    Nitros Power Member

    Joined:
    Jan 30, 2009
    Messages:
    573
    Likes Received:
    295
  5. oneill

    oneill Registered Member

    Joined:
    Oct 2, 2010
    Messages:
    52
    Likes Received:
    9
    any other tool ?
     
  6. kokoloko75

    kokoloko75 Elite Member

    Joined:
    Jan 1, 2011
    Messages:
    1,628
    Likes Received:
    1,936
    Occupation:
    Design director
    Location:
    Paris (France)
    Try to put your file on Localhost (local server) and use classic tools.

    Beny
     
  7. schwagoo

    schwagoo Jr. Executive VIP Jr. VIP Premium Member

    Joined:
    Nov 8, 2010
    Messages:
    807
    Likes Received:
    737
    Location:
    Midwest, USA
    you do NOT want to buy uBot just for this. ubot has a fairly steep learning curve and it would be a terrible waste of money to buy it for this.

    Post up in the freelancer section. A decent PHP programmer should be able to make you a custom script for this in less than an hour. Put a $20 price tag on it and I bet someone will make it for you right away.
     
  8. luminus

    luminus Junior Member

    Joined:
    Oct 21, 2008
    Messages:
    112
    Likes Received:
    32
    Occupation:
    Operations, UBot Studio
    Location:
    Virtually Anywhere
    Home Page:
    Not to just push ubot, as I'd agree you could outsource this much easier, but if you're going to do it a lot or do other tasks like this, you'd save money in the long run with a Standard license. But only if you've got other stuff to apply it to!



     
  9. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    Spadix Extract Link will do that.