Ultimate scraper be like ?

GrandScraperG said:
definitely not sharing the code.
Can you explain more, which places should scrape and who will be interested in the solution ?
Click to expand...
I thought you want to contribute to the community by creating free solutions.
 
Advertise on BHW
GrandScraperG said:
definitely not sharing the code.
Can you explain more, which places should scrape and who will be interested in the solution ?
Click to expand...
cse.google.com + serpdigger.com
the ultimate way as i already said roi.im is the place you are looking for their tools are using custome search engine by google this way you can target a website/niche/country or whatever you get a full control of what you are looking for and where to look for it
 
Do you have experience on automating tasks that take lots of time and bandwidth like video uploading? residential proxies suck for that because they rotate, any other idea besides building my own residential proxy network?
 
KardoseR said:
Do you have experience on automating tasks that take lots of time and bandwidth like video uploading? residential proxies suck for that because they rotate, any other idea besides building my own residential proxy network?
Click to expand...

try to buy proxies with better response time and/or (if you're building ur own thing) implement a system that handle errors and timeouts.
 
KardoseR said:
Do you have experience on automating tasks that take lots of time and bandwidth like video uploading? residential proxies suck for that because they rotate, any other idea besides building my own residential proxy network?
Click to expand...

I have been using luminati for video upload and it worked fine. you should make sure your scripts for video upload are good.
And also to have a good deal about prices

also netnut is good service.
 
1.Scrape sites that have sql query "SELECT something from..." or "UPDAE/INSERT" in HTTP request.
2. Scrape 5+ years old sites, that are not mobile friendly and not W3C valid.
 
using python and lxml xpath to scrape isnt a big deal for an ida and gdb professional but its all about creativity and good planing well i dont think your rev eng career would help you with this i used to be sort of hacker i have worked with alot of heap and use after free bugs but i think creativity is harder thn fuzzing and exploiting some memory leaks or idunno
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top