Very good Scraper.
However, if I import 50,000 URL to scrap for example, it takes quite a long time and hang a lot.
It seems the application is not CPU multithreaded. (But it is for the network and can check up to 500 connections at once)
Any idea how to speed up the importation?
However, if I import 50,000 URL to scrap for example, it takes quite a long time and hang a lot.
It seems the application is not CPU multithreaded. (But it is for the network and can check up to 500 connections at once)
Any idea how to speed up the importation?