If you could scrape data from any website, what would you scrape?

Icey Dan

Icey Dan

Power Member
Joined
Nov 24, 2014
Messages
559
Reaction score
628
As a career web programmer, my latest project has been learning how to use PHP to efficiently scrape data from various websites. I have finally mastered the art of scraping and structuring the data how I need it for the web applications I build as a hobby.

Data is very valuable in this day and age as we all know, so my question is this: If you had the power to scrape data from any site, what site would you scrape? And why?
 
Advertise on BHW
Icey Dan said:
As a career web programmer, my latest project has been learning how to use PHP to efficiently scrape data from various websites. I have finally mastered the art of scraping and structuring the data how I need it for the web applications I build as a hobby.

Data is very valuable in this day and age as we all know, so my question is this: If you had the power to scrape data from any site, what site would you scrape? And why?
Click to expand...
Any adult website as adult and dating are very profitable niches
 
Aiden L said:
Any adult website as adult and dating are very profitable niches
Click to expand...

Interesting idea. Mind elaborating on what specifically you would scrape from adult sites?
 
Create userful information for daytraders with data from the market.

I am not gonna say a lot about it, because it is alredy a plan I am working on.

Send me a DM if interested
 
I would scar for all the car parts, I mean every single piece of a car and every maker + year and so on.
A database like that would be nice.
 
scraping data is old shit now, we are using API instead
 
I'd scrape ads and sell the data
 
this is really helpfull. i was wondering why all that scrapers data for what?
i have an idea for newbie like me lol
do you mind share 1 sample site with what data to scrape inside? it will be a training for me to try to scrape and understand the process
 
vario150 said:
Google and Bing must be shit since they are biggest scraper sites of all
Click to expand...
Do you prefer make request and get what u need , or spend hours to scrap 3000000 row ?
 
Are U scared from losing your source of income then , did you now that you can make any website an api shit in few lines ?
 
Ipnp said:
Are U scared from losing your source of income then , did you now that you can make any website an api shit in few lines ?
Click to expand...
The choice whether to use a few lines or thousands lines of code doesn't matter. Instead, what matters is writing code that suitable for its intended use.

I'm not against API whatsoever. I use web scraping whenever the API is suck.

I'm free anyway. If not spent most of my time watching anime, i write code to kill time :D
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top