Tools To Scrape Local Biz Data
- Thread starter Von Maxim
- Start date
kalrudra
BANNED
- Oct 29, 2010
- 271
- 301
Send me url and detailed description. I can make custom scraper for you within your budget range.
jenyasimon
Junior Member
- Mar 12, 2010
- 146
- 44
Look out for GPS Scrapper I don't know where did I got it but it must be from BHW
i have made all my web scrappers in php
i basicly make them to mirror a websites content, ie i want to get good content on a hoilday website i own, so i extract the information from one already established site and add it to mine
i bascily use curl in php, just running from a local host server
the process is simple really
stage one extract the links from the page(s) you want
run threw the pages extracting the infomartion required, at this point either save it or post it to your site - in your case it would be simply saved for offline use
theres nothing complex about it, just time comsumming
i basicly make them to mirror a websites content, ie i want to get good content on a hoilday website i own, so i extract the information from one already established site and add it to mine
i bascily use curl in php, just running from a local host server
the process is simple really
stage one extract the links from the page(s) you want
run threw the pages extracting the infomartion required, at this point either save it or post it to your site - in your case it would be simply saved for offline use
theres nothing complex about it, just time comsumming
I would never use Web Data Extractor for custom fields extracting , the best results I got with this tool (till now I have extracted more than 200 websites with it):
http://www.webextract.net/
I never found a free version , so I purchased it for 69 $ , but it worth it , setting up a website pattern lasts less then 1 minute , then you sit and watch while you get records from every website you immagine into tool's spreadsheet , then you can export it in HTML, CSV , XLS, TXT , different databases . For example over night I have extracted Google Maps USA with 70K records line by line with more than 20 custom fields (many of them duplicates which this tool automaticaly removes) . For HTML export you can even use MAIL merge variables . I have purchased and used many tools and this one was the best.
http://www.webextract.net/
I never found a free version , so I purchased it for 69 $ , but it worth it , setting up a website pattern lasts less then 1 minute , then you sit and watch while you get records from every website you immagine into tool's spreadsheet , then you can export it in HTML, CSV , XLS, TXT , different databases . For example over night I have extracted Google Maps USA with 70K records line by line with more than 20 custom fields (many of them duplicates which this tool automaticaly removes) . For HTML export you can even use MAIL merge variables . I have purchased and used many tools and this one was the best.
Last edited:
BeerNuts
Newbie
- Mar 12, 2008
- 46
- 15
Kinda useless to op by now since this is from 2011 but I figured I would bump it incase anyone else is looking. But if you need a scraper for local business data you should check out Local Scraper its scrapes business data from a couple of sites and has been working great.