What would YOU Scrape? I'm learning PHP and need some projects :)

HealeyV3

Power Member
Joined
Mar 4, 2009
Messages
521
Reaction score
348
I've been making quite a few PHP based tools, such as a bulk proxy checker, amazon product info scraper, goo.gl scraper, bulk instant deploy php emailer, etc, and I'm finally out of ideas.

So, if you could scrape anything you want on the web, what would it be?
Examples:

1. Scrape Amazon for Entire Product Database
2. Scrape CNN for top headlines and save info to file.
3. Scrape Netflix for Movies DB.
etc... you get the idea.

Also assume you have unlimited proxies (private), and a good VPS.

Go!
 
and are we getting the scraper when you are done??

PM me.
 
a hundred different movie linking sites to feed into a huge database for one mega site to rule all t3h piraciez
 
Glad to see you're learning PHP :)

I'm not sure if you've already done this or not, but how about a framework class for scraping...
I created mine about 6months ago and use it on every web based project using Curl. (It will save you a lot of time on future projects).
 
A working google suggester. The one in dwnld section doesnt work anymore.
 
Back
Top