What's your favorite web scraping tool?

kaizer

BANNED - Failed to resolve a dispute

Dec 8, 2006

2,857

338

• Feb 3, 2023

• #21

My favorite tool was Scrapebox

 

tombanner1988

Regular Member

Jr. VIP

Nov 29, 2022

407

67

• Feb 5, 2023

• #22

Python will be best, its free to learn and implement ,Good Luck bro

 

The Heisenberg

Regular Member

Feb 26, 2021

431

55

• Mar 30, 2023

• #23

I use for my project scrapebox. You can also try.

 

I

ivan2020

Registered Member

Jun 15, 2021

70

25

• Apr 3, 2023

• #24

general34 said:

Try Scrapy (python framework)

Click to expand...

Yeah, I agree. I use this often too. But Beautiful Soup even easy, as for me.

 

Agrippa Nuako

Newbie

Jul 24, 2019

35

32

• Aug 29, 2023

• #25

Combine Python's module :request and BeautifulSoup.
Or Selenium for more dynamic webpages and JavaScript heavy sites can do the scraping.

 

Ricardo L

Newbie

Aug 29, 2023

17

16

• Aug 29, 2023

• #26

My favorite web scraping tool is Scrapy, a free and open-source web crawling framework written in Python.

 

Hiexperts

Power Member

Jr. VIP

Mar 29, 2023

688

55

• Aug 30, 2023

• #27

Use Scrapy, Selenium, WebHarvy, and Beautiful Soup.

 

thedorf

Elite Member

Oct 1, 2008

2,558

1,819

• Aug 30, 2023

• #28

Ormosis said:

What tools are you using to extract content, leads, or whatever you need?

Click to expand...

Scrapebox all the way.

 

T

Ticonort

Failed to resolve dispute

Dec 27, 2022

121

19

• Aug 31, 2023

• #29

Scrapebox is the best.

 

l33t'

Supreme Member

Jr. VIP

Jun 4, 2020

1,386

459

• Aug 31, 2023

• #30

Scrapebox only.

 

WebsiteDesignAgency

Junior Member

Jun 30, 2013

112

44

• Aug 31, 2023

• #31

BeautifulSoup or Scrapy, you can use ChatGPT to make your own scripts with basic knowledge. Maybe a fun way to learn.

 

good_luck_commander

Junior Member

Nov 2, 2022

143

77

• Aug 31, 2023

• #32

I also mostly use Scrape and BeautifulSoup with Python

 

lingster

Newbie

Jan 3, 2023

25

16

• Aug 31, 2023

• #33

scrapy and selenium....coupled with using ChatGPT to pull out the correct xpath

 

V

Voordeel

Banned-Rules Violation

Mar 29, 2023

76

8

• Sep 4, 2023

• #34

Try Scrapy. It's a powerful and flexible Python framework that allows you to easily extract content and data from websites for various purposes like lead generation, content scraping, and more.

 

mehedi7707

Senior Member

Jr. VIP

Apr 26, 2018

1,138

181

• Sep 9, 2023

• #35

scrapebox

 

K

kishwerb

Newbie

Aug 25, 2023

17

4

• Sep 10, 2023

• #36

Ormosis said:

Currently, we are using Apify (which is quite impressive), but it's time to explore other options.

What tools are you using to extract content, leads, or whatever you need?

Click to expand...

Scrapebox and Scrapingbee are best.

 

proxygo

Elite Member

Executive VIP

Jr. VIP

Nov 2, 2008

59,100

26,627

• Sep 10, 2023

• #37

Ormosis said:

Currently, we are using Apify (which is quite impressive), but it's time to explore other options.
What tools are you using to extract content, leads, or whatever you need?

Click to expand...

gsa / scrapebox.

 

S

Steee

BANNED

Jun 16, 2023

81

15

• Sep 17, 2023

• #38

If you have high quality socks5 dedicated, static, or private proxy with username and password you can Go with scrapebox tools. I am using this tool since last 3 years.

 

ByteSmith

Regular Member

May 17, 2023

484

62

• Sep 17, 2023

• #39

ScrapeBox is good I use it. It works very well.

 

Ropelyn

Registered Member

Aug 9, 2022

71

22

• Sep 18, 2023

• #40

goless is good and no-code