scrapping

Advertise on BHW
Now that is some serious amount of data, with lot of fields to scrape. You wont really be able to find a scrapper that can do it on its own. Your best bet is to hire a programmer who can scrape it for you.

If you just want to copy the website as a whole, you can try using httrack, but that doesnt give you the datas into an excel or a database, but would only copy the page as is. Do let me know if you need to get it done.
 
once the site is copied, would it not save the data on server and then we can make somthing out of there, to give feed to my sites i want with that data
 
Bennylearning said:
once the site is copied, would it not save the data on server and then we can make somthing out of there, to give feed to my sites i want with that data
Click to expand...

Having the site copied would be same as using the current site. There would be no difference at all. I mean, it wont give you all the data into an excel or a database. It would just save the pages as is, which is what you have in the site now.
 
Repulsor said:
Having the site copied would be same as using the current site. There would be no difference at all. I mean, it wont give you all the data into an excel or a database. It would just save the pages as is, which is what you have in the site now.
Click to expand...
I think what he means is using the site as basis for real time values that will be forwarded to his sites. Probably won't be using it for himself but will be "borrowing" the data for his sites.
 
Bennylearning said:
once the site is copied, would it not save the data on server and then we can make somthing out of there, to give feed to my sites i want with that data
Click to expand...
You'll need to hire programmers that specialize in web scraping and creating a script that will run on your server and collect the data from the site and throw them onto your own sites. You can hire one here in this forum or on other freelancing platforms.
 
Yes you are right i need a progammer. thanks for your advise boss, i have to come back to this point in few days time
 
bartosimpsonio said:
They sell that data (https://www.numbeo.com/common/api.jsp) so they probably won't let you scrape it in high volume.
Click to expand...

You can scrape high volume if you have a shit ton of different ip's. Also something to consider in this equation.
 
Debian said:
You can scrape high volume if you have a shit ton of different ip's. Also something to consider in this equation.
Click to expand...

24*7 running a PHP Scrapper with TOR is what I use when I can allow some errors/missing data. Or ProxyRental instead of TOR( with its on call IP rotation feature,just like in TOR) when I want more reliability.
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top