- Sep 25, 2013
- 4,705
- 2,701
So I scrapped a massive website but when trying to check for the external links they're so many that netspider just stops responding, damn.
Try that regex exclusion thing. It should help.So I scrapped a massive website but when trying to check for the external links they're so many that netspider just stops responding, damn.
UPD: the program I used was updated and it looks different now. Crawling parameters were moved to the sidebar. I hope it won't be a problem.
Hey man.I'm having a bit of difficulty figuring it out with the update. Screenshot added above. Can use some guidance![]()
Hey man.
You need to open the main table, then right click anywhere on that table.
A menu will open, in that menu go to Current table > Outgoing External links
Here's s screenshot:
![]()