Cannot capture URL's by descending 20 levels

PandaBusters

Registered Member
Joined
Jun 10, 2017
Messages
71
Reaction score
6
Hi,
I have scrape box, and I am trying to scrape all the URL's by crawling 20 levels with the "Grab URL's by crawling" feature, down 20 levels. The problem is, it only grabs that which has the same root domain, not the other links or URL's. Is this a basic limitation in the software, or do I gave to give it a macro, wildcard, some other way or grabbing all links? Thanks.
 
Ok, thanks, the trick i to start with the root URL as a keyword, then harvest more URL's.

The other problem is, I cannot transfer the URL's to the comment poster.See the screenshot:

Screenshot-Scrapebox-cannot-transfer-URLs-to-comment-poster.gif
 
Ok, thanks, the trick i to start with the root URL as a keyword, then harvest more URL's.

The other problem is, I cannot transfer the URL's to the comment poster.See the screenshot:

Screenshot-Scrapebox-cannot-transfer-URLs-to-comment-poster.gif


If you want to scrape just a domain you can use grab links by crawling sites. If you want external domains as well, then you can use the link extractor, but be aware your files can get large fast, so you need a lot of memory (RAM) to get 20 levels deep. You will also probably have to break it up into chunks.

Video


I don't understand your screenshot about not being able to transfer them to the poster, right in your screenshot are the two options to transfer them to the poster. Or worst case just export to file and import where you are trying to import.
 
Hi Matt,
There are two bugs in the software. I just upgraded to 2.0.0.100, which did get rid of the failure of not extracting e-mail addresses, but none of the URL transfer to comment poster features works, but it did before upgrade. I may have to uninstall and reinstall.
 
Hi Matt,
There are two bugs in the software. I just upgraded to 2.0.0.100, which did get rid of the failure of not extracting e-mail addresses, but none of the URL transfer to comment poster features works, but it did before upgrade. I may have to uninstall and reinstall.
both transfer options work for me in the .100 version.

You can download a fresh copy to a new folder on your desktop.

http://www.scrapebox.com/payment-received
 
Back
Top