Looking for a good webcrawler other than Scrapebox. Need it to extract all the available links in the website. Needs to be multi-threaded with proxy support. Scrapebox keeps crashing and I need something with more filters if its available. I've searched and tried a few out today, but they didnt multi-thread or had proxy support.