Cannot capture URL's by descending 20 levels

PandaBusters

Registered Member
Joined
Jun 10, 2017
Messages
71
Reaction score
6
Hi,
I have scrape box, and I am trying to scrape all the URL's by crawling 20 levels with the "Grab URL's by crawling" feature, down 20 levels. The problem is, it only grabs that which has the same root domain, not the other links or URL's. Is this a basic limitation in the software, or do I gave to give it a macro, wildcard, some other way or grabbing all links? Thanks.
 

PandaBusters

Registered Member
Joined
Jun 10, 2017
Messages
71
Reaction score
6
Ok, thanks, the trick i to start with the root URL as a keyword, then harvest more URL's.

The other problem is, I cannot transfer the URL's to the comment poster.See the screenshot:

Screenshot-Scrapebox-cannot-transfer-URLs-to-comment-poster.gif
 

loopline

Jr. VIP
Jr. VIP
Joined
Jan 25, 2009
Messages
5,947
Reaction score
3,382
Website
contactformmarketing.com
Ok, thanks, the trick i to start with the root URL as a keyword, then harvest more URL's.

The other problem is, I cannot transfer the URL's to the comment poster.See the screenshot:

Screenshot-Scrapebox-cannot-transfer-URLs-to-comment-poster.gif


If you want to scrape just a domain you can use grab links by crawling sites. If you want external domains as well, then you can use the link extractor, but be aware your files can get large fast, so you need a lot of memory (RAM) to get 20 levels deep. You will also probably have to break it up into chunks.

Video


I don't understand your screenshot about not being able to transfer them to the poster, right in your screenshot are the two options to transfer them to the poster. Or worst case just export to file and import where you are trying to import.
 

PandaBusters

Registered Member
Joined
Jun 10, 2017
Messages
71
Reaction score
6
Hi Matt,
There are two bugs in the software. I just upgraded to 2.0.0.100, which did get rid of the failure of not extracting e-mail addresses, but none of the URL transfer to comment poster features works, but it did before upgrade. I may have to uninstall and reinstall.
 

loopline

Jr. VIP
Jr. VIP
Joined
Jan 25, 2009
Messages
5,947
Reaction score
3,382
Website
contactformmarketing.com
Hi Matt,
There are two bugs in the software. I just upgraded to 2.0.0.100, which did get rid of the failure of not extracting e-mail addresses, but none of the URL transfer to comment poster features works, but it did before upgrade. I may have to uninstall and reinstall.
both transfer options work for me in the .100 version.

You can download a fresh copy to a new folder on your desktop.

http://www.scrapebox.com/payment-received
 
Top