1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

What's a good URL scraper

Discussion in 'Black Hat SEO Tools' started by phatzilla, Apr 28, 2010.

  1. phatzilla

    phatzilla Supreme Member

    Joined:
    Apr 9, 2009
    Messages:
    1,366
    Likes Received:
    1,017
    This is what i need to do:

    Scrape a very large forum for all urls contained in posts. Is there anything that can do this for me?
     
  2. waynezz

    waynezz Junior Member

    Joined:
    Apr 6, 2009
    Messages:
    104
    Likes Received:
    14
    Have you taken a look at Scrapebox?
     
  3. elpadrino23

    elpadrino23 Registered Member

    Joined:
    Jan 4, 2009
    Messages:
    89
    Likes Received:
    21
    Scrapebox at the moment is the best..if you can afford it you can also try the one that comes with xrumer
     
  4. Paper-Boy

    Paper-Boy Elite Member

    Joined:
    Jun 17, 2009
    Messages:
    5,116
    Likes Received:
    1,821
    there are a few tools listed in this section that does what youre asking for. search it up.
     
  5. blackbirdtrail

    blackbirdtrail Newbie

    Joined:
    Apr 24, 2010
    Messages:
    19
    Likes Received:
    3
    Occupation:
    SEO/SEM
    Location:
    Arizona, USA
    Scrapebox ! I have had it for 4 days now and it is unreal all the different stuff this can do...worth way more than the $57 it's selling for. It will do your URL scrape !

    Black Bird
    Posted via Mobile Device
     
  6. Derek Foreal

    Derek Foreal Junior Member

    Joined:
    Apr 10, 2010
    Messages:
    190
    Likes Received:
    767
    Gender:
    Male
    Location:
    East Coast USA
    I would say write a simple Python script...and that's totally Free...lol
    It's an awesome language anyone can learn, and quick!

    It's not hard at all, and if your at all familiar with iMacros you'll pick Python right up. If all you need is every link on the page you can do that with like 3-4 very small lines of code. Check out "Diving Into Python" and you'll have a scraper ready to go within 15mins or so.