Good Web Crawler better than Scrapebox?

Looking for a good webcrawler other than Scrapebox. Need it to extract all the available links in the website.

Needs to be multi-threaded with proxy support.

Scrapebox keeps crashing and I need something with more filters if its available.

I've searched and tried a few out today, but they didnt multi-thread or had proxy support.

Have you tried gscraper? Or you can also get all internal and external links using the online tool HREF

chiqui3d said:

Have you tried gscraper? Or you can also get all internal and external links using the online tool HREF

Click to expand...

i'll give it a try. The sites Im trying to crawl have 100,000,000 links internally. Need something strong.