Ampix0
Power Member
- Jan 10, 2012
- 527
- 60
I have Scrapebox and Web Harvy, web harvy is definitely more of what I need for this but I don't believe it can do what I need either. Web harvy is very good at scraping information off a page and then proceeding to the next page. Very good for tabular data that might run multiple pages, like yellow book
What I often run in to is a list of links, and the information I need is all still formatted the same so Web Harvy COULD pick it up, but you have to follow the link, grab the info, come back, go to the next link and so on. Web Harvy can not go another level deep is what I mean (as far as I know).
ex:
Now imagine each one of those is a link to a profile page like so:
I need the information from each page like so scraped.
What I often run in to is a list of links, and the information I need is all still formatted the same so Web Harvy COULD pick it up, but you have to follow the link, grab the info, come back, go to the next link and so on. Web Harvy can not go another level deep is what I mean (as far as I know).
ex:
Code:
[B]List of Tennis Players[/B]
Person 1
Person 2
...
NEXT PAGENow imagine each one of those is a link to a profile page like so:
Code:
[B]Person 1[/B]
score: 86
height: 5'3
...I need the information from each page like so scraped.
