1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

>> NEED HELP!! How to Scrape Yellow pages or Google Maps for Business listings

Discussion in 'Black Hat SEO' started by cdn_craigs, Jun 17, 2012.

  1. cdn_craigs

    cdn_craigs Jr. VIP Jr. VIP

    Joined:
    Jul 16, 2011
    Messages:
    1,156
    Likes Received:
    326
    Occupation:
    PAY PER CALL GURU at your service...
    Location:
    Canada
    Home Page:
    hi guys

    I need to scrape a Los Angeles listings for "electricians" - for content for my business directory blog.

    How can i do this? ( I do have scrapebox, but not sure how to do it with this)

    ANY HELP WOULD BE GREAT!!
     
  2. webdesign

    webdesign Jr. VIP Jr. VIP Premium Member

    Joined:
    May 9, 2009
    Messages:
    415
    Likes Received:
    113
    Occupation:
    unemployed
    Location:
    UK
    Php/server or wamp/simplephpdom
     
  3. salimoflaz

    salimoflaz Newbie

    Joined:
    Feb 16, 2012
    Messages:
    20
    Likes Received:
    1
    Can you post the link of the website and what kind of information you want to scrape? Maybe I can help?

    Best
     
  4. jinsandy

    jinsandy Regular Member

    Joined:
    Jun 17, 2008
    Messages:
    374
    Likes Received:
    81
    ill barter this service if u have something worth trading for?
     
  5. artizhay

    artizhay BANNED BANNED

    Joined:
    Nov 21, 2010
    Messages:
    1,867
    Likes Received:
    1,335
    Never tried it, but GPScraper looks promising...
    Though, you'll have to find a solution that is compatible with the newly revised listing pages, and I'm not sure if GPScraper is.
     
  6. Crewchief007

    Crewchief007 Power Member

    Joined:
    May 27, 2009
    Messages:
    731
    Likes Received:
    525
    Gender:
    Male
    Occupation:
    Internet Marketer
    Location:
    Online
    LOL, @ webdesign, would you care to expound?

    @ cdn_craigs, there is a YP scraper in the DL section, enjoy.
     
    • Thanks Thanks x 1
  7. johndoejohndoe

    johndoejohndoe Junior Member

    Joined:
    Feb 13, 2011
    Messages:
    177
    Likes Received:
    33
    webdesign told you what would get the job done. You need to know how to use a server such as xampp, then using some php, a database, and the simple php dom parser, loop through and insert the listings into the db. The reason you would setup xampp or wamp is because on a host like 1and1, you can't change the maximum time a script can run for. Instead of letting something run endlessly, you'll be cut-off every 30 seconds or so. It's pretty annoying an ineffective to do it that way, when you can easily do it the other way. If you want an "easy" way to do it, without doing any programming, then this probably isn't a good way.
     
    Last edited: Jun 17, 2012
  8. artizhay

    artizhay BANNED BANNED

    Joined:
    Nov 21, 2010
    Messages:
    1,867
    Likes Received:
    1,335
    I believe crewchief's point is that half the questions on BHW can be solved with PHP, but such a generic answer doesn't help anyone now does it? Aside from that, it doesn't address the proxy rotation and/or throttling that would be necessary.
     
  9. johndoejohndoe

    johndoejohndoe Junior Member

    Joined:
    Feb 13, 2011
    Messages:
    177
    Likes Received:
    33
    Well, my point was that it isn't a generic answer. It tells cdn_craig exactly what to use to get the job done, aside from actually doing it, posting the code, or resulting data. If he wants to do it with scrapebox, then it's obviously a horrible answer.
     
    Last edited: Jun 18, 2012
  10. odd-job

    odd-job Junior Member

    Joined:
    Mar 13, 2008
    Messages:
    111
    Likes Received:
    12
  11. Von Maxim

    Von Maxim Registered Member

    Joined:
    Aug 3, 2010
    Messages:
    98
    Likes Received:
    47
    @cdn_craigs

    I own and use Yellow Pages Spider & Google Maps Extractor. They work great and are constantly updated.
    You can find more info here. http://www.touchesoftware.com/

    MAX
     
  12. degroundshaker

    degroundshaker Newbie

    Joined:
    Oct 28, 2012
    Messages:
    4
    Likes Received:
    1
    Well, all of the scrapper which are given above have $ubscriptions.

    I would recommend "YELLOW PAGES SCRAPPER"
     
  13. degroundshaker

    degroundshaker Newbie

    Joined:
    Oct 28, 2012
    Messages:
    4
    Likes Received:
    1
    get it from

    goo gl/Fk3zW
     
  14. degroundshaker

    degroundshaker Newbie

    Joined:
    Oct 28, 2012
    Messages:
    4
    Likes Received:
    1
    get it from

    goo gl/Fk3zW
     
    • Thanks Thanks x 1
  15. _Escort_

    _Escort_ Newbie

    Joined:
    Nov 30, 2012
    Messages:
    2
    Likes Received:
    0
    I know one software that can help you in this request. It includes different scrapers - Google, Manta, Yellow pages and etc. It's called LGS(Lead Generation Software). Here:
     
  16. camuk

    camuk Junior Member

    Joined:
    Sep 28, 2012
    Messages:
    137
    Likes Received:
    27
    Occupation:
    Self Employed
    Location:
    BHW!!
    Home Page:
    I've heard of yellabot. Never used it though.
     
  17. CryptoCoinDev

    CryptoCoinDev Newbie

    Joined:
    Jan 29, 2014
    Messages:
    6
    Likes Received:
    1
    Occupation:
    Programmer, Developer, Penetration Tester, Ethical
    Location:
    Rabbit Hole
    Home Page:
    I can make customized, highly complex web scrapers to scrape just about any website or online database. I've done this for some of my clients already. I'm a programmer by profession and this is NOT a spam posting. My phone: +1 347 467 1118