What's a good URL scraper

P

phatzilla

Supreme Member

Apr 9, 2009

1,428

1,086

• Apr 28, 2010

• #1

This is what i need to do:

Scrape a very large forum for all urls contained in posts. Is there anything that can do this for me?

 

W

waynezz

Junior Member

Apr 6, 2009

104

14

• Apr 28, 2010

• #2

Have you taken a look at Scrapebox?

 

E

elpadrino23

Registered Member

Jan 4, 2009

88

23

• Apr 28, 2010

• #3

Scrapebox at the moment is the best..if you can afford it you can also try the one that comes with xrumer

 

P

Paper-Boy

Elite Member

Jun 17, 2009

5,116

1,840

• Apr 29, 2010

• #4

there are a few tools listed in this section that does what youre asking for. search it up.

 

B

blackbirdtrail

Newbie

Apr 24, 2010

19

3

• Apr 29, 2010

• #5

Scrapebox ! I have had it for 4 days now and it is unreal all the different stuff this can do...worth way more than the $57 it's selling for. It will do your URL scrape !

Black Bird
Posted via Mobile Device

 

Derek Foreal

Regular Member

Apr 10, 2010

202

788

• Apr 29, 2010

• #6

I would say write a simple Python script...and that's totally Free...lol
It's an awesome language anyone can learn, and quick!

It's not hard at all, and if your at all familiar with iMacros you'll pick Python right up. If all you need is every link on the page you can do that with like 3-4 very small lines of code. Check out "Diving Into Python" and you'll have a scraper ready to go within 15mins or so.