[HELP] How to scrape information from websites

AnotherOne

Senior Member
Joined
Nov 28, 2011
Messages
1,021
Reaction score
208
Hi,
I want to know how to scrape data (phone numbers specifically) from yellow pages or other/similar websites. I have Scrapebox and already read that awesome tut added here by one superb user but I was not able to understand it properly since there's little to no information given about phone number scraping.

The data will be used for cold calling (only to those specific individuals who ask for specific services).
 
I believe it can be done with sp, but for this sort of scraping I am using content downloader, it is Russian soft, but they have English version,
it can scrape any part of websites, it can scrape items from shop sites, articles, it need some time to learn, but then you will be able to scrape any data from any websites.
 
Use Imacros. If you use it as a plugin, its free and can do the job you need i guess.
 
What's sp?
Link to that software and it's tut please.

I believe it can be done with sp, but for this sort of scraping I am using content downloader, it is Russian soft, but they have English version,
it can scrape any part of websites, it can scrape items from shop sites, articles, it need some time to learn, but then you will be able to scrape any data from any websites.




Let me try it.

Use Imacros. If you use it as a plugin, its free and can do the job you need i guess.
 
The video on the page shows the Russian version of their software. Is it available in English? Which version you're using? Is their Ultimate version worth $32?
* I am not Russian and Google translate provide unreadable translation.

For those who ask SP = scrapebox
Russian software = http://sbfactory.ru/?p=600
 
Depending upon how techie you are, visual web ripper has a 14 day free trial & several video tutorials on how to use it.

if you can code at all (especially Python), selenium ode can be used to scrape quite nicely. If you are hitting YP often, then invest in a proxy service.
 
The video on the page shows the Russian version of their software. Is it available in English? Which version you're using? Is their Ultimate version worth $32?
* I am not Russian and Google translate provide unreadable translation.

As being Russian I am using it as it is, but I have got news quite long time ago about English version is out, it is need time to learn, but it is absolutely best scraper I know
 
Visual web ripper looks like a great tool but their price is $300+ :/
Using Selenium IDE seems like a good idea but I don't know how to code in Phyton.

Depending upon how techie you are, visual web ripper has a 14 day free trial & several video tutorials on how to use it.

if you can code at all (especially Python), selenium ode can be used to scrape quite nicely. If you are hitting YP often, then invest in a proxy service.



Do you have any link for the English version of that software?

As being Russian I am using it as it is, but I have got news quite long time ago about English version is out, it is need time to learn, but it is absolutely best scraper I know
 
Due to Ubot being a pile of shite lately I have been teaching myself PhantomJS / CasperJS - just getting used to it but its quite easy to scrape with. If you have a bit of tech in you, take a look :)
 
Due to Ubot being a pile of shite lately I have been teaching myself PhantomJS / CasperJS - just getting used to it but its quite easy to scrape with. If you have a bit of tech in you, take a look :)

I second this. Or better yet phantomjs + facebooks phpwebdriver. If its not ajax based just php+xpath :-)
 
Does somebody mention import.io service? Maybe, you should try - it's free and works not bad + a lot of lessons on youtube.
 
The problem with phone scraping is the fact that websites that serve personal informations will write phones as pictures or implement a javascript injection so that you can't scrape them easily
 
Back
Top