1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scrapper which suits you

Discussion in 'Scripting' started by JerryWoodburn, May 9, 2017.

Tags:
  1. JerryWoodburn

    JerryWoodburn Newbie

    Joined:
    Oct 23, 2016
    Messages:
    20
    Likes Received:
    0
    Gender:
    Male
    Hello guys.
    I've been wondering,what are the scrappers you are using?
    I tried Jsoup (java). Looks nice,well documented,but the work with proxies is pain.
    What would you recommend? I am familiar with java,but pretty much everything is also fine for me.
    Thanks for answers!
     
  2. JerryWoodburn

    JerryWoodburn Newbie

    Joined:
    Oct 23, 2016
    Messages:
    20
    Likes Received:
    0
    Gender:
    Male
    (Something that can use proxies easily,of course)
     
  3. codefoxdens

    codefoxdens Newbie

    Joined:
    May 8, 2017
    Messages:
    41
    Likes Received:
    5
    Gender:
    Male
    Use python + requests + selenium + beautifulsoup = Do everything
     
    • Thanks Thanks x 1
  4. Automation247

    Automation247 Regular Member

    Joined:
    Jan 21, 2014
    Messages:
    486
    Likes Received:
    169
    Gender:
    Male
    Occupation:
    Making some $$$
    Location:
    SPAMMING 24/7 FROM SOMEWHERE IN EUROPE
    Home Page:
  5. JerryWoodburn

    JerryWoodburn Newbie

    Joined:
    Oct 23, 2016
    Messages:
    20
    Likes Received:
    0
    Gender:
    Male
    Thanks!
    But I prefer http.requests though
     
  6. BambaSamba

    BambaSamba Newbie

    Joined:
    Jun 2, 2017
    Messages:
    6
    Likes Received:
    0
    Gender:
    Male
    you can code a python script very easy to learn in 2-4 days you can make a good scraper lot of resources on python scrapers on Stack Overflow and do a search on google i hope this helps
     
  7. Charles Roberto

    Charles Roberto Newbie

    Joined:
    Jun 3, 2017
    Messages:
    16
    Likes Received:
    3
    Gender:
    Female
    I usually make my own webcrawlers combining the python libraries beautifulsoup + requests
     
  8. Nut-Nights

    Nut-Nights Jr. VIP Jr. VIP

    Joined:
    Jun 20, 2013
    Messages:
    5,296
    Likes Received:
    3,375
    Location:
    Hell
    Home Page:
    what yo guys talking about ? Scrapebox is best.
     
  9. lakerr

    lakerr Regular Member

    Joined:
    Jun 20, 2012
    Messages:
    246
    Likes Received:
    81
    Python with bs and selenium