Scraping website list - useful resource

Purush

Elite Member

Jul 12, 2016

6,750

2,427

• Feb 13, 2020

• #1

Now a days scraping and making content is one of the essential and here you go. You could find your own tool based on your specification.

http://tabula.technology/
http://www.crummy.com/software/BeautifulSoup/
https://www.octoparse.com/
https://www.import.io/
https://www.parsehub.com/
https://www.crawlmonster.com/
https://www.connotate.com/
https://commoncrawl.org/
http://crawly.diffbot.com/
https://sequentum.com/
http://www.contentgrabber.com/
https://www.diffbot.com/
https://www.octoparse.com/
http://www.fminer.com/
https://scrapy.org/
https://www.heliumscraper.com/eng/
https://www.npmjs.com/package/scrape-it
https://scraperwiki.com/
https://scrapinghub.com/
https://www.webharvy.com/

 

perrymason

Elite Member

Jul 19, 2018

1,704

838

• Feb 13, 2020

• #2

much appreciated mate !

 

liyong601c

Supreme Member

Jr. VIP

Mar 30, 2010

1,279

415

• Feb 13, 2020

• #3

Can you do a simple classification?

 

liyong601c

Supreme Member

Jr. VIP

Mar 30, 2010

1,279

415

• Feb 13, 2020

• #4

Can you do a simple classification?

 

The_Magician

Regular Member

Dec 12, 2019

308

110

• Feb 13, 2020

• #5

thanks for the list

 

Purush

Elite Member

Jul 12, 2016

6,750

2,427

• Feb 14, 2020
• Thread Starter Thread Starter

• #6

liyong601c said:

Can you do a simple classification?

Click to expand...

Most of the website name itself will make it understandable mate.

 

L

Linu

Power Member

Jul 4, 2019

797

182

• Feb 14, 2020

• #7

Thanks for the list mate

 

Lord_RK

Regular Member

Jr. VIP

Nov 11, 2019

339

108

• Feb 14, 2020

• #8

Thanks for sharing mate.

 

medosla97

Junior Member

Nov 14, 2016

102

51

• Feb 16, 2020

• #9

Thanks for this list mate

 

sony108

Regular Member

Jr. VIP

May 14, 2019

207

97

• Feb 16, 2020

• #10

Wow. Thx again! All the best!

 

Furious Man

Elite Member

Jr. VIP

Aug 4, 2015

4,548

680

• Feb 17, 2020

• #11

Bookmarked Great thanks for this post...

 

A

alyk

Newbie

Feb 5, 2020

1

0

• Mar 4, 2020

• #12

Purush said:

Now a days scraping and making content is one of the essential and here you go. You could find your own tool based on your specification.

http://tabula.technology/
http://www.crummy.com/software/BeautifulSoup/
https://www.octoparse.com/
https://www.import.io/
https://www.parsehub.com/
https://www.crawlmonster.com/
https://www.connotate.com/
https://commoncrawl.org/
http://crawly.diffbot.com/
https://sequentum.com/
http://www.contentgrabber.com/
https://www.diffbot.com/
https://www.octoparse.com/
http://www.fminer.com/
https://scrapy.org/
https://www.heliumscraper.com/eng/
https://www.npmjs.com/package/scrape-it
https://scraperwiki.com/
https://scrapinghub.com/
https://www.webharvy.com/

Click to expand...

also you may add to your list eCemmerce scrapre e-scraper dot com

 

JesterKI

Junior Member

Jun 22, 2019

119

34

• Mar 11, 2020

• #13

Thank you !

 

sdc_

Junior Member

Jan 21, 2020

158

86

• Mar 11, 2020

• #14

Thanks for the list, I've used BeautifulSoup in the past and it worked well!

 

Lady Trieu

Power Member

Jan 14, 2020

589

172

• Mar 16, 2020

• #15

Thanks for the tool @Purush.

 

SeRptrIx

Senior Member

Feb 18, 2020

819

251

• Mar 17, 2020

• #16

Thank you mate for the sharing...

 

Krise656

Senior Member

Jr. VIP

Jul 1, 2018

858

505

• Mar 18, 2020

• #17

Great list, thanks!

 

TheKingSlayer

Power Member

Mar 20, 2019

755

715

• Mar 18, 2020

• #18

Good share, will be useful

 

Mudundo07

BANNED

Mar 18, 2020

73

46

• Mar 18, 2020

• #19

There are too many free python scrapers on GitHub.. Why pay!

 

jumbuck

Newbie

Aug 30, 2012

44

20

• Mar 19, 2020

• #20

This is just what I was looking for thanks