1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

What would YOU Scrape? I'm learning PHP and need some projects :)

Discussion in 'Black Hat SEO' started by HealeyV3, Dec 10, 2011.

  1. HealeyV3

    HealeyV3 Power Member

    Joined:
    Mar 4, 2009
    Messages:
    521
    Likes Received:
    344
    I've been making quite a few PHP based tools, such as a bulk proxy checker, amazon product info scraper, goo.gl scraper, bulk instant deploy php emailer, etc, and I'm finally out of ideas.

    So, if you could scrape anything you want on the web, what would it be?
    Examples:

    1. Scrape Amazon for Entire Product Database
    2. Scrape CNN for top headlines and save info to file.
    3. Scrape Netflix for Movies DB.
    etc... you get the idea.

    Also assume you have unlimited proxies (private), and a good VPS.

    Go!
     
  2. Virus1

    Virus1 Supreme Member

    Joined:
    Dec 13, 2010
    Messages:
    1,326
    Likes Received:
    1,409
    Occupation:
    destroyer of worlds...
    Location:
    Welcome to Black Hat World........................
    Home Page:
    and are we getting the scraper when you are done??

    PM me.
     
  3. neuromancer

    neuromancer Newbie

    Joined:
    Jun 12, 2010
    Messages:
    48
    Likes Received:
    26
    a hundred different movie linking sites to feed into a huge database for one mega site to rule all t3h piraciez
     
  4. xpwizard

    xpwizard Junior Member

    Joined:
    Nov 6, 2010
    Messages:
    198
    Likes Received:
    122
    Glad to see you're learning PHP :)

    I'm not sure if you've already done this or not, but how about a framework class for scraping...
    I created mine about 6months ago and use it on every web based project using Curl. (It will save you a lot of time on future projects).
     
  5. Neo240

    Neo240 Power Member

    Joined:
    Sep 13, 2011
    Messages:
    543
    Likes Received:
    329
    Occupation:
    Hitman
    Location:
    Vacation
    A working google suggester. The one in dwnld section doesnt work anymore.