[HELP] How to scrape information from websites

AnotherOne · Mar 13, 2015

Hi,
I want to know how to scrape data (phone numbers specifically) from yellow pages or other/similar websites. I have Scrapebox and already read that awesome tut added here by one superb user but I was not able to understand it properly since there's little to no information given about phone number scraping.

The data will be used for cold calling (only to those specific individuals who ask for specific services).

m.rvs2141 · Mar 13, 2015

I believe it can be done with sp, but for this sort of scraping I am using content downloader, it is Russian soft, but they have English version,
it can scrape any part of websites, it can scrape items from shop sites, articles, it need some time to learn, but then you will be able to scrape any data from any websites.

yenerich · Mar 13, 2015

Use Imacros. If you use it as a plugin, its free and can do the job you need i guess.

AnotherOne · Mar 14, 2015

What's sp?
Link to that software and it's tut please.

m.rvs2141 said:
I believe it can be done with sp, but for this sort of scraping I am using content downloader, it is Russian soft, but they have English version,
it can scrape any part of websites, it can scrape items from shop sites, articles, it need some time to learn, but then you will be able to scrape any data from any websites.

Let me try it.

yenerich said:
Use Imacros. If you use it as a plugin, its free and can do the job you need i guess.

thecontractman · Mar 14, 2015

do you please have the link for the Russian scaper please?

m.rvs2141 · Mar 14, 2015

thecontractman said:
do you please have the link for the Russian scaper please?

For those who ask SP = scrapebox
Russian software = http://sbfactory.ru/?p=600

AnotherOne · Mar 15, 2015

The video on the page shows the Russian version of their software. Is it available in English? Which version you're using? Is their Ultimate version worth $32?
* I am not Russian and Google translate provide unreadable translation.

m.rvs2141 said:
For those who ask SP = scrapebox
Russian software = http://sbfactory.ru/?p=600

vayacondios · Mar 15, 2015

Depending upon how techie you are, visual web ripper has a 14 day free trial & several video tutorials on how to use it.

if you can code at all (especially Python), selenium ode can be used to scrape quite nicely. If you are hitting YP often, then invest in a proxy service.

m.rvs2141 · Mar 15, 2015

AnotherOne said:
The video on the page shows the Russian version of their software. Is it available in English? Which version you're using? Is their Ultimate version worth $32?
* I am not Russian and Google translate provide unreadable translation.

As being Russian I am using it as it is, but I have got news quite long time ago about English version is out, it is need time to learn, but it is absolutely best scraper I know

AnotherOne · Mar 15, 2015

Visual web ripper looks like a great tool but their price is $300+ :/
Using Selenium IDE seems like a good idea but I don't know how to code in Phyton.

vayacondios said:
Depending upon how techie you are, visual web ripper has a 14 day free trial & several video tutorials on how to use it.

if you can code at all (especially Python), selenium ode can be used to scrape quite nicely. If you are hitting YP often, then invest in a proxy service.

Do you have any link for the English version of that software?

m.rvs2141 said:
As being Russian I am using it as it is, but I have got news quite long time ago about English version is out, it is need time to learn, but it is absolutely best scraper I know

abhinav703 · Mar 15, 2015

AnotherOne said:
Do you have any link for the English version of that software?

use this for translation
http://labs.microsofttranslator.com/bookmarklet/
its will translate whole site to English for you. it always come handy to me

Hope it helps

fatboy · Mar 15, 2015

Due to Ubot being a pile of shite lately I have been teaching myself PhantomJS / CasperJS - just getting used to it but its quite easy to scrape with. If you have a bit of tech in you, take a look

actproxy · Mar 16, 2015

With a butterknife.

jamie3000 · Mar 16, 2015

fatboy said:
Due to Ubot being a pile of shite lately I have been teaching myself PhantomJS / CasperJS - just getting used to it but its quite easy to scrape with. If you have a bit of tech in you, take a look

I second this. Or better yet phantomjs + facebooks phpwebdriver. If its not ajax based just php+xpath

olegall · Mar 28, 2015

Does somebody mention import.io service? Maybe, you should try - it's free and works not bad + a lot of lessons on youtube.

vlad000 · Mar 28, 2015

The problem with phone scraping is the fact that websites that serve personal informations will write phones as pictures or implement a javascript injection so that you can't scrape them easily

[HELP] How to scrape information from websites

AnotherOne

Senior Member

m.rvs2141

Senior Member

yenerich

Supreme Member

AnotherOne

Senior Member

thecontractman

Junior Member

m.rvs2141

Senior Member

AnotherOne

Senior Member

vayacondios

Newbie

m.rvs2141

Senior Member

AnotherOne

Senior Member

abhinav703

Junior Member

fatboy

Elite Member

actproxy

Regular Member

jamie3000

Elite Member

olegall

Newbie

vlad000

Newbie

Main Menu

Marketplace

Making Money

BlackHat World