any one know of a scrapping sys?

yes, I have heard of scrapebox but i was wondering if there is more options out there?

scrapebox is ok - just remember they abandoned there bhw
sales thread a few years back .
I do remember i was wondering if there is more options out there... scrapebox isnt as fast as it used to be.

you can use open source scrapers with froxy
oh? interesting... might give that a try.
 
Don't do scrapping. It's the most pointless web activity you can do. You get tons of data that you think is suddenly unique to you (its not! people have scraped and sold whatever you can find over and over again already) You can't sell it anywhere, and its unlikly you'll have the resources to suddenly contact your scraped list, or use it in such a way that is meaningful without full on loads of costs. The bet yu'll be able to do is sell your services to noobs that want things scraped that can't program themslves. Good luck finding an opporunity, this is where every noob freelancer starts and probably ends! lol

Take time to plan out something that is uniquely more of what you are interested in and represents your interests and passion. We are in the world of interaction, and the competition is getting hotter with more cool projects getting engineered as software now thanks to vibe coding. Go where the opportunity is. Scraping for money is done with. It's too easy for ANYONE to vibe code a python program in 1 hour to scrape most sites. But they fail to realise they need proxies, and thats just a whole nuther world of scams! lol (Dropped ip's and dirty connections)
 
Don't do scrapping. It's the most pointless web activity you can do. You get tons of data that you think is suddenly unique to you (its not! people have scraped and sold whatever you can find over and over again already) You can't sell it anywhere, and its unlikly you'll have the resources to suddenly contact your scraped list, or use it in such a way that is meaningful without full on loads of costs. The bet yu'll be able to do is sell your services to noobs that want things scraped that can't program themslves. Good luck finding an opporunity, this is where every noob freelancer starts and probably ends! lol

Take time to plan out something that is uniquely more of what you are interested in and represents your interests and passion. We are in the world of interaction, and the competition is getting hotter with more cool projects getting engineered as software now thanks to vibe coding. Go where the opportunity is. Scraping for money is done with. It's too easy for ANYONE to vibe code a python program in 1 hour to scrape most sites. But they fail to realise they need proxies, and thats just a whole nuther world of scams! lol (Dropped ip's and dirty connections)
Really? Scraping from classifieds, facebook groups, and marketplaces so you can find quick items to flip? What about scraping my competitors pages to copy content on auto pilot? Scraping emails from influencers and selling them on fivver? hmmm :anyway:
 
Really? Scraping from classifieds, facebook groups, and marketplaces so you can find quick items to flip? What about scraping my competitors pages to copy content on auto pilot? Scraping emails from influencers and selling them on fivver? hmmm :anyway:
If YOU are actually doing that, and making money, then you my friend are a man of talent. If you are are advising this person cause you see other people with ads, "supposidly" making money. Then you my friend are a snake oil salesman's salesman lol
 
If YOU are actually doing that, and making money, then you my friend are a man of talent. If you are are advising this person cause you see other people with ads, "supposidly" making money. Then you my friend are a snake oil salesman's salesman lol
I dont know what ads your talking about, but there's so many clever ways of making money scraping I think it's funny you say its the most pointless activity just because YOU have never made money from it. How do you think these multimillion dollar companies make so much money why do you think companies like brightdata exist? Companies like Apollo? Dude no offense but you sound like a noob, theres plenty of money in scraping.
 
I dont know what ads your talking about, but there's so many clever ways of making money scraping I think it's funny you say its the most pointless activity just because YOU have never made money from it. How do you think these multimillion dollar companies make so much money why do you think companies like brightdata exist? Companies like Apollo? Dude no offense but you sound like a noob, theres plenty of money in scraping.
You sound like a noob to me though :) lol . I have experiance in buying scraped data and using free scraped data, and scraping my own.

Your right i never made money from it. Very few people can or do. I think my point is to you that you havn't either.

Your posts is not made up of "Dude you talk pish i meant $250k selling scraped classified ads from craiglist"

I seen all the posts on BHW where people scraped and wanted to know how to make money, you can search them all there is one every week. WHy aren't any of these dude, millionaires yet? lol Yes, i get there is a market for it. But that doesn't mean its not an explotative market that feeds on peoples need to somehow make it big with scraped data.
 
I have actually made money from it its super easy. Let me put it to you like this am I going to spend 12 hrs scraping setting up proxies and a server to get some data if I don't know a damn thing about scraping and might spend a week figuring it out OR I could buy it for 50 bucks or maybe pay monthly for? Thats exactly how people feel, emails, brand mentions, sentiment analyzers all sorts of shit. Look through these bhw sellers tons of these guys selling lists or info they gathered over weeks of scraping stuff I've paid for myself! There's your proof, are they going to get rich? No probably not, but it's a good way to start, its a good side hustle.
 
Following this thread, I’m also looking for a solid scraping system. Ideally something that can handle dynamic sites + export clean data (CSV/Google Sheets). If anyone has tested tools like Apify/Octoparse/Scrapy, would love to hear what worked best for you.
Can i know how/where to sell th data ?
 
Don't do scrapping. It's the most pointless web activity you can do. You get tons of data that you think is suddenly unique to you (its not! people have scraped and sold whatever you can find over and over again already) You can't sell it anywhere, and its unlikly you'll have the resources to suddenly contact your scraped list, or use it in such a way that is meaningful without full on loads of costs. The bet yu'll be able to do is sell your services to noobs that want things scraped that can't program themslves. Good luck finding an opporunity, this is where every noob freelancer starts and probably ends! lol

Take time to plan out something that is uniquely more of what you are interested in and represents your interests and passion. We are in the world of interaction, and the competition is getting hotter with more cool projects getting engineered as software now thanks to vibe coding. Go where the opportunity is. Scraping for money is done with. It's too easy for ANYONE to vibe code a python program in 1 hour to scrape most sites. But they fail to realise they need proxies, and thats just a whole nuther world of scams! lol (Dropped ip's and dirty connections)
they might be more to do than scraping what people has scraped, scraping itself is a blackhat tough job, you are only sounding like one who takes the jobs as kiddos
 
What kind of scraping are you looking to do? Websites, search results, social media, e commerce sites, or something else? The best tool usually depends on the source. I've had decent experiences with Python libraries like BeautifulSoup and Scrapy for general web scraping, but the requirements can be very different depending on what you're trying to collect.
 
What you want actually to scrap?? there are a few options, most people use tools like Python (BeautifulSoup / Scrapy) or no code tools like Apify and ParseHub for scraping depending on how technical you want to go.
 
@artemisrose Scrapebox is still fine for footprints/harvesting type stuff, but if you want cleaner data I’d look at Scrapy + Playwright, or Apify if you dont wanna babysit scripts all day. Octoparse/ParseHub are okay for simple jobs but they get annoying once the site changes layout. Main thing is decide what you are scraping first... search results, ecommerce, socials, directories etc, because one “best” tool doesnt really exist. Also dont scrape random data then think how to sell it after, that’s where most people waste weeks.
 
I think you're better off using any proxy system that can reach the target, and then banging something out getting the data and seeing what you can do with it. There's no reason to overcomplicate the setup or tooling. It's all fluid and these things change every year at this point. Best really is just a browser at this point. I don't know what usecases people go to all this trouble for about optimizing using tls spoofing and custom parser etc. A real browser will just load the damn page, run several of them, let it run for some time, touch grass. Compute is so ridiculously cheap at this point it's not worth the effort to try to get an "optimized" system when your time could be better spent optimizing ROI instead of pennies.
 
Back
Top