1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[HELP] How to scrape information from websites

Discussion in 'Black Hat SEO Tools' started by AnotherOne, Mar 13, 2015.

Tags:
  1. AnotherOne

    AnotherOne Senior Member

    Joined:
    Nov 28, 2011
    Messages:
    950
    Likes Received:
    189
    Occupation:
    SQA
    Location:
    JMeter & Selenium
    Hi,
    I want to know how to scrape data (phone numbers specifically) from yellow pages or other/similar websites. I have Scrapebox and already read that awesome tut added here by one superb user but I was not able to understand it properly since there's little to no information given about phone number scraping.

    The data will be used for cold calling (only to those specific individuals who ask for specific services).
     
  2. m.rvs2141

    m.rvs2141 Power Member

    Joined:
    Feb 22, 2011
    Messages:
    794
    Likes Received:
    748
    I believe it can be done with sp, but for this sort of scraping I am using content downloader, it is Russian soft, but they have English version,
    it can scrape any part of websites, it can scrape items from shop sites, articles, it need some time to learn, but then you will be able to scrape any data from any websites.
     
    • Thanks Thanks x 1
  3. yenerich

    yenerich Jr. VIP Jr. VIP

    Joined:
    May 26, 2013
    Messages:
    1,162
    Likes Received:
    181
    Home Page:
    Use Imacros. If you use it as a plugin, its free and can do the job you need i guess.
     
    • Thanks Thanks x 1
  4. AnotherOne

    AnotherOne Senior Member

    Joined:
    Nov 28, 2011
    Messages:
    950
    Likes Received:
    189
    Occupation:
    SQA
    Location:
    JMeter & Selenium
    What's sp?
    Link to that software and it's tut please.




    Let me try it.

     
  5. thecontractman

    thecontractman Registered Member

    Joined:
    Jun 18, 2011
    Messages:
    88
    Likes Received:
    14
    do you please have the link for the Russian scaper please?
     
  6. m.rvs2141

    m.rvs2141 Power Member

    Joined:
    Feb 22, 2011
    Messages:
    794
    Likes Received:
    748
    For those who ask SP = scrapebox
    Russian software = http://sbfactory.ru/?p=600
     
    • Thanks Thanks x 1
  7. AnotherOne

    AnotherOne Senior Member

    Joined:
    Nov 28, 2011
    Messages:
    950
    Likes Received:
    189
    Occupation:
    SQA
    Location:
    JMeter & Selenium
    The video on the page shows the Russian version of their software. Is it available in English? Which version you're using? Is their Ultimate version worth $32?
    * I am not Russian and Google translate provide unreadable translation.

     
  8. vayacondios

    vayacondios Newbie

    Joined:
    Mar 3, 2015
    Messages:
    30
    Likes Received:
    5
    Depending upon how techie you are, visual web ripper has a 14 day free trial & several video tutorials on how to use it.

    if you can code at all (especially Python), selenium ode can be used to scrape quite nicely. If you are hitting YP often, then invest in a proxy service.
     
    • Thanks Thanks x 1
  9. m.rvs2141

    m.rvs2141 Power Member

    Joined:
    Feb 22, 2011
    Messages:
    794
    Likes Received:
    748
    As being Russian I am using it as it is, but I have got news quite long time ago about English version is out, it is need time to learn, but it is absolutely best scraper I know
     
  10. AnotherOne

    AnotherOne Senior Member

    Joined:
    Nov 28, 2011
    Messages:
    950
    Likes Received:
    189
    Occupation:
    SQA
    Location:
    JMeter & Selenium
    Visual web ripper looks like a great tool but their price is $300+ :/
    Using Selenium IDE seems like a good idea but I don't know how to code in Phyton.



    Do you have any link for the English version of that software?

     
  11. abhinav703

    abhinav703 Junior Member

    Joined:
    Oct 12, 2014
    Messages:
    127
    Likes Received:
    36
    use this for translation
    http://labs.microsofttranslator.com/bookmarklet/
    its will translate whole site to English for you. it always come handy to me

    Hope it helps
     
  12. fatboy

    fatboy Elite Member

    Joined:
    Aug 13, 2008
    Messages:
    1,618
    Likes Received:
    3,229
    Occupation:
    Retired
    Location:
    Old Peoples Home
    Due to Ubot being a pile of shite lately I have been teaching myself PhantomJS / CasperJS - just getting used to it but its quite easy to scrape with. If you have a bit of tech in you, take a look :)
     
  13. agsllc

    agsllc Jr. VIP Jr. VIP

    Joined:
    Nov 5, 2014
    Messages:
    400
    Likes Received:
    24
    Location:
    USA
    Home Page:
    With a butterknife.
     
    • Thanks Thanks x 1
  14. jamie3000

    jamie3000 Supreme Member

    Joined:
    Jun 30, 2014
    Messages:
    1,311
    Likes Received:
    587
    Occupation:
    Finance coder looking for semi-retirement
    Location:
    uk
    I second this. Or better yet phantomjs + facebooks phpwebdriver. If its not ajax based just php+xpath :)
     
  15. olegall

    olegall Newbie

    Joined:
    Sep 11, 2014
    Messages:
    1
    Likes Received:
    0
    Does somebody mention import.io service? Maybe, you should try - it's free and works not bad + a lot of lessons on youtube.
     
  16. vlad000

    vlad000 Newbie

    Joined:
    Feb 15, 2015
    Messages:
    14
    Likes Received:
    2
    The problem with phone scraping is the fact that websites that serve personal informations will write phones as pictures or implement a javascript injection so that you can't scrape them easily