yes it removes dupes in the Cleaning Room.
After scraping, drop the list into the cleaner, hit the remove duplicates and any other cleaning you want done.
I recommend using all of them, remove spaces and Apply White/list filter.
Optionally you can use the Validation, but that one takes a bit...