Can scrapebox scrape an entire website?

macdonjo3

Elite Member

Jr. VIP

Nov 8, 2009

8,887

9,192

• Nov 30, 2024

• #1

The link extractor plugin only goes down 1 level so you have to babysit it and keep exporting/importing until you have enough levels. There seems to be no way to scrape an entire site.

I know this could be done in Python in 100 lines of code but surely there has to be a way to do it in the most advanced SEO scraping tool ever? Or GSA?

 

Vevo

Failed to resolve a dispute resolution thread.

Jan 30, 2018

358

83

• Nov 30, 2024

• #2

To scrape an entire website, there are more specialized tools like HTTrack or SiteSucker

 

macdonjo3

Elite Member

Jr. VIP

Nov 8, 2009

8,887

9,192

• Nov 30, 2024
• Thread Starter Thread Starter

• #3

Hamit Can said:

To scrape an entire website, there are more specialized tools like HTTrack or SiteSucker

Click to expand...

Not trying to download the entire website, I just mean all of the URLs

 

Steptoe

Elite Member

Jr. Executive VIP

Jr. VIP

Aug 9, 2017

5,576

6,862

• Dec 2, 2024

• #4

Does the site in question have a sitemap available? If so you could just extract the urls from that.

 

T

tingyu

BANNED

Nov 29, 2024

1

0

• Dec 2, 2024

• #5

may i aks if you can penetrate

 

R

Ripley545

Registered Member

May 3, 2013

52

14

• Dec 3, 2024

• #6

is the app still working? it doesn't look that the app is working.

 

reCaptchaSolver

Newbie

Nov 26, 2023

16

3

• Dec 3, 2024

• #7

both gsa ser and scrapebox can do. but with ser probly you will need some changes on search engine lines.

scrapebox and hrefer both can do.

just set levels to like 4 - 5

 

G

gmc93

Senior Member

Aug 24, 2015

824

633

• Dec 3, 2024

• #8

You should update your link extractor...here is mine