I've scraped craigslist to email potential clients to my directory, but I find people have several pages with the same content in different cities. How can I take my list of craigslist urls and delete the duplicate content urls so I'm not sending these people multiple emails?
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.