Easiest website to scrape biz listings?

Raffy

Raffy

Regular Member
Joined
Nov 30, 2012
Messages
211
Reaction score
646
Anyone know of an online business directory that won't limit your IP if you scrape their listings? I need to build a database of all U.S. businesses but I know most of the obvious sites to crawl like yellowbook or yellowpages will limit your access if you hit them hard with a crawler. The database needs to be updated frequently so buying an existing database won't work. Any help is appreciated.
 
Advertise on BHW
Why can't you just use Tor? There are libraries out there that provide an API for most of the major languages to submit requests through the Tor network. What language is your scraper written in?
 
Geeza said:
Why can't you just use Tor? There are libraries out there that provide an API for most of the major languages to submit requests through the Tor network. What language is your scraper written in?
Click to expand...
Tor is just really, really slow. It's useful if you're into really blackhat stuff but not really viable for scraping loads of data. I suspect there are directories out there with lenient rules so I'd like to make this as simple as possible and hopefully avoid having to change IPs.
 
This is an easy one. Scrapebox :) Scrape proxies, scrape related keywords, find footprints that work for example site:siteyourscraping and possibly others depending on what business directories your scraping.

You also get the huge amount of filtering tools. the sky really is the limit. Admittedly blog commenting is basically worthless now.
 
I second localscraper and kimono. Good experiences with move. I don't suppose places scout would help? I don't recall what they do...
 
Thanks for the feedback for Local Scraper. I am the owner and its great to see others recommend the product. I hope other people find this post when looking for a local lead scraper.
 
Hello Mates, I am new to SEO and Email marketing. I want a Huge database of B2B emails and data.I have seen review on Scrapebox. I want someone experiened in this to point me in the right direction I am willing to pay for this. 'm available on Skype
 
Yes, I know few of them. You can use Yelp for listing your business and it will not block your IP address. However, you can also use proxies as an alternative.
 
Hello mate!

You can use kimono labs to get better results.
 
We have been using custom bot to scrape business listing sometimes gscraper.
 
I think you must have to try Tor for it.
You must have to use local citation links for scraping Biz listings easily and efficiently.
 
You can try and Google "Lead Scrape". It uses public proxy, and you can add your own private proxy too.
I'm one of the developer, so maybe a bit biased, it scrapes business name, address, website, email and even contact people working at the company.
Have a look at it, there is a free trial on the website that shows the software potential. And supports more than 25 countries.
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top