GScraper Doubt

If scraping session is stopped and restarted, GScraper scrapes all keywords and footprints again?

If you select "remove used keywords at scrape finished", when your stop scrape, GScraper can delete the used keywords and then you can continue scrape.
And when you restart the soft, GScraper can record the keywords and footprints auto.

add, with the pic of setting:

On topic with GScraper, after a scraping has finished and youre left with 50 -100, 1 million url txt files, is there a quick way to remove the duplicates? or do you need to load each one manually (like I have been doing) into GScraper and remove them 1 at a time?

Thanks