hi guys I need to scrape a Los Angeles listings for "electricians" - for content for my business directory blog. How can i do this? ( I do have scrapebox, but not sure how to do it with this) ANY HELP WOULD BE GREAT!!
Can you post the link of the website and what kind of information you want to scrape? Maybe I can help? Best
Never tried it, but GPScraper looks promising... Though, you'll have to find a solution that is compatible with the newly revised listing pages, and I'm not sure if GPScraper is.
LOL, @ webdesign, would you care to expound? @ cdn_craigs, there is a YP scraper in the DL section, enjoy.
webdesign told you what would get the job done. You need to know how to use a server such as xampp, then using some php, a database, and the simple php dom parser, loop through and insert the listings into the db. The reason you would setup xampp or wamp is because on a host like 1and1, you can't change the maximum time a script can run for. Instead of letting something run endlessly, you'll be cut-off every 30 seconds or so. It's pretty annoying an ineffective to do it that way, when you can easily do it the other way. If you want an "easy" way to do it, without doing any programming, then this probably isn't a good way.
I believe crewchief's point is that half the questions on BHW can be solved with PHP, but such a generic answer doesn't help anyone now does it? Aside from that, it doesn't address the proxy rotation and/or throttling that would be necessary.
Well, my point was that it isn't a generic answer. It tells cdn_craig exactly what to use to get the job done, aside from actually doing it, posting the code, or resulting data. If he wants to do it with scrapebox, then it's obviously a horrible answer.
@cdn_craigs I own and use Yellow Pages Spider & Google Maps Extractor. They work great and are constantly updated. You can find more info here. http://www.touchesoftware.com/ MAX
Well, all of the scrapper which are given above have $ubscriptions. I would recommend "YELLOW PAGES SCRAPPER"
I know one software that can help you in this request. It includes different scrapers - Google, Manta, Yellow pages and etc. It's called LGS(Lead Generation Software). Here:
I can make customized, highly complex web scrapers to scrape just about any website or online database. I've done this for some of my clients already. I'm a programmer by profession and this is NOT a spam posting. My phone: +1 347 467 1118
