1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Easiest website to scrape biz listings?

Discussion in 'Local SEO' started by Raffy, Aug 17, 2014.

  1. Raffy

    Raffy Regular Member

    Joined:
    Nov 30, 2012
    Messages:
    212
    Likes Received:
    613
    Anyone know of an online business directory that won't limit your IP if you scrape their listings? I need to build a database of all U.S. businesses but I know most of the obvious sites to crawl like yellowbook or yellowpages will limit your access if you hit them hard with a crawler. The database needs to be updated frequently so buying an existing database won't work. Any help is appreciated.
     
  2. Geeza

    Geeza Newbie

    Joined:
    Jan 21, 2013
    Messages:
    9
    Likes Received:
    3
    Occupation:
    Software Engineer
    Location:
    UK
    Why can't you just use Tor? There are libraries out there that provide an API for most of the major languages to submit requests through the Tor network. What language is your scraper written in?
     
    • Thanks Thanks x 2
  3. Raffy

    Raffy Regular Member

    Joined:
    Nov 30, 2012
    Messages:
    212
    Likes Received:
    613
    Tor is just really, really slow. It's useful if you're into really blackhat stuff but not really viable for scraping loads of data. I suspect there are directories out there with lenient rules so I'd like to make this as simple as possible and hopefully avoid having to change IPs.
     
  4. jordank90

    jordank90 Newbie

    Joined:
    Dec 8, 2014
    Messages:
    34
    Likes Received:
    2
    Occupation:
    Website designer/Internet marketer
    Location:
    United Kingdom
    This is an easy one. Scrapebox :) Scrape proxies, scrape related keywords, find footprints that work for example site:siteyourscraping and possibly others depending on what business directories your scraping.

    You also get the huge amount of filtering tools. the sky really is the limit. Admittedly blog commenting is basically worthless now.
     
  5. andreint

    andreint Regular Member

    Joined:
    Jun 28, 2014
    Messages:
    286
    Likes Received:
    34
    Location:
    Under The Hat
    Home Page:
    • Thanks Thanks x 2
  6. Second Mate

    Second Mate Newbie Premium Member

    Joined:
    Feb 12, 2014
    Messages:
    43
    Likes Received:
    9
    Occupation:
    Digital Strategist
    Location:
    The Darkside
    I second LocalScraper, been an awesome tool for me
     
  7. BlueSteele

    BlueSteele Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 10, 2010
    Messages:
    282
    Likes Received:
    134
    Location:
    Vancouver, BC
    I second localscraper and kimono. Good experiences with move. I don't suppose places scout would help? I don't recall what they do...
     
  8. BeerNuts

    BeerNuts Newbie

    Joined:
    Mar 12, 2008
    Messages:
    29
    Likes Received:
    6
    Home Page:
    Thanks for the feedback for Local Scraper. I am the owner and its great to see others recommend the product. I hope other people find this post when looking for a local lead scraper.
     
    • Thanks Thanks x 2
  9. Aliveprox3

    Aliveprox3 Newbie

    Joined:
    Sep 18, 2015
    Messages:
    1
    Likes Received:
    0
    Hello Mates, I am new to SEO and Email marketing. I want a Huge database of B2B emails and data.I have seen review on Scrapebox. I want someone experiened in this to point me in the right direction I am willing to pay for this. 'm available on Skype
     
  10. bmminc

    bmminc Regular Member

    Joined:
    Nov 29, 2014
    Messages:
    385
    Likes Received:
    279
    This is gold. Never seen this site. This tool alone, plus some basic local SEO knowledge and a good attitude and you can bring in some nice $$$ from B2B sales.
     
  11. lukelo12

    lukelo12 BANNED BANNED

    Joined:
    Apr 12, 2015
    Messages:
    72
    Likes Received:
    7
    Yes, I know few of them. You can use Yelp for listing your business and it will not block your IP address. However, you can also use proxies as an alternative.
     
  12. irweazel

    irweazel Junior Member

    Joined:
    Dec 31, 2015
    Messages:
    112
    Likes Received:
    7
    Location:
    LA to the bay
    Hello mate!

    You can use kimono labs to get better results.
     
  13. SECONDS

    SECONDS Jr. VIP Jr. VIP Premium Member

    Joined:
    Dec 31, 2015
    Messages:
    135
    Likes Received:
    11
    We have been using custom bot to scrape business listing sometimes gscraper.
     
  14. JProckerzon

    JProckerzon Registered Member

    Joined:
    Jan 10, 2016
    Messages:
    69
    Likes Received:
    3
    Location:
    Los Angeles, US
    You must have to try
    Tor and Local Scraper for biz listings.
     
  15. ConsultJoseph

    ConsultJoseph Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 25, 2014
    Messages:
    180
    Likes Received:
    22
    Gender:
    Male
    Location:
    Pearl of the Orient Seas
    Home Page:
    Checking out Local Scraper. Looking impressive so far!
     
  16. northlondonboy

    northlondonboy Newbie

    Joined:
    Dec 22, 2015
    Messages:
    1
    Likes Received:
    0
    Hi everyone - is there a localscraper for UK? Thanks in advance
     
  17. living2xl

    living2xl Senior Member

    Joined:
    Dec 9, 2011
    Messages:
    1,195
    Likes Received:
    133
    Occupation:
    sippin dat juice
    Location:
    Not sleeping!
    Home Page:
    I think you must have to try Tor for it.
    You must have to use local citation links for scraping Biz listings easily and efficiently.
     
  18. seomax

    seomax Newbie

    Joined:
    Jun 21, 2012
    Messages:
    22
    Likes Received:
    3
    You can try and Google "Lead Scrape". It uses public proxy, and you can add your own private proxy too.
    I'm one of the developer, so maybe a bit biased, it scrapes business name, address, website, email and even contact people working at the company.
    Have a look at it, there is a free trial on the website that shows the software potential. And supports more than 25 countries.