Scrapper which suits you

JerryWoodburn

Newbie

Oct 23, 2016

20

0

• May 9, 2017

• #1

Hello guys.
I've been wondering,what are the scrappers you are using?
I tried Jsoup (java). Looks nice,well documented,but the work with proxies is pain.
What would you recommend? I am familiar with java,but pretty much everything is also fine for me.
Thanks for answers!

 

JerryWoodburn

Newbie

Oct 23, 2016

20

0

• May 9, 2017
• Thread Starter Thread Starter

• #2

(Something that can use proxies easily,of course)

 

C

codefoxdens

Newbie

May 8, 2017

41

5

• May 15, 2017

• #3

Use python + requests + selenium + beautifulsoup = Do everything

 

Automation247

Regular Member

Jan 21, 2014

485

196

• May 15, 2017

• #4

Node.js + Google Chrome headless mode: https://developers.google.com/web/updates/2017/04/headless-chrome

 

JerryWoodburn

Newbie

Oct 23, 2016

20

0

• May 15, 2017
• Thread Starter Thread Starter

• #5

Automation247 said:

Node.js + Google Chrome headless mode: https://developers.google.com/web/updates/2017/04/headless-chrome

Click to expand...

Thanks!
But I prefer http.requests though

 

B

BambaSamba

Newbie

Jun 2, 2017

6

0

• Jun 4, 2017

• #6

you can code a python script very easy to learn in 2-4 days you can make a good scraper lot of resources on python scrapers on Stack Overflow and do a search on google i hope this helps

 

C

Charles Roberto

Newbie

Jun 3, 2017

16

3

• Jun 11, 2017

• #7

I usually make my own webcrawlers combining the python libraries beautifulsoup + requests

 

Nut-Nights

Elite Member

Executive VIP

Jr. VIP

Jun 20, 2013

11,503

8,911

• Jun 11, 2017

• #8

what yo guys talking about ? Scrapebox is best.

 

lakerr

Power Member

Jun 20, 2012

505

180

• Jun 11, 2017

• #9

Python with bs and selenium