Easiest website to scrape biz listings?

[Raffy]

Anyone know of an online business directory that won't limit your IP if you scrape their listings? I need to build a database of all U.S. businesses but I know most of the obvious sites to crawl like yellowbook or yellowpages will limit your access if you hit them hard with a crawler. The database needs to be updated frequently so buying an existing database won't work. Any help is appreciated.

 

[Geeza]

Why can't you just use Tor? There are libraries out there that provide an API for most of the major languages to submit requests through the Tor network. What language is your scraper written in?

 

[Raffy]

Why can't you just use Tor? There are libraries out there that provide an API for most of the major languages to submit requests through the Tor network. What language is your scraper written in?

Tor is just really, really slow. It's useful if you're into really blackhat stuff but not really viable for scraping loads of data. I suspect there are directories out there with lenient rules so I'd like to make this as simple as possible and hopefully avoid having to change IPs.

 

[jordank90]

This is an easy one. Scrapebox Scrape proxies, scrape related keywords, find footprints that work for example site:siteyourscraping and possibly others depending on what business directories your scraping.

You also get the huge amount of filtering tools. the sky really is the limit. Admittedly blog commenting is basically worthless now.

 

[andreint]

try this one: http://www.localscraper.com/

 

[Second Mate]

I second LocalScraper, been an awesome tool for me

 

[BlueSteele]

I second localscraper and kimono. Good experiences with move. I don't suppose places scout would help? I don't recall what they do...

 

[BeerNuts]

Thanks for the feedback for Local Scraper. I am the owner and its great to see others recommend the product. I hope other people find this post when looking for a local lead scraper.

 

[Aliveprox3]

Hello Mates, I am new to SEO and Email marketing. I want a Huge database of B2B emails and data.I have seen review on Scrapebox. I want someone experiened in this to point me in the right direction I am willing to pay for this. 'm available on Skype

 

[bmminc]

try this one: http://www.localscraper.com/

This is gold. Never seen this site. This tool alone, plus some basic local SEO knowledge and a good attitude and you can bring in some nice $$$ from B2B sales.

 

[lukelo12]

Yes, I know few of them. You can use Yelp for listing your business and it will not block your IP address. However, you can also use proxies as an alternative.

 

[irweazel]

Hello mate!

You can use kimono labs to get better results.

 

[SECONDS]

We have been using custom bot to scrape business listing sometimes gscraper.

 

[JProckerzon]

You must have to try
Tor and Local Scraper for biz listings.

 

[ConsultJoseph]

Checking out Local Scraper. Looking impressive so far!

 

[northlondonboy]

Hi everyone - is there a localscraper for UK? Thanks in advance

 

[living2xl]

I think you must have to try Tor for it.
You must have to use local citation links for scraping Biz listings easily and efficiently.

 

[seomax]

You can try and Google "Lead Scrape". It uses public proxy, and you can add your own private proxy too.
I'm one of the developer, so maybe a bit biased, it scrapes business name, address, website, email and even contact people working at the company.
Have a look at it, there is a free trial on the website that shows the software potential. And supports more than 25 countries.