Hey guys, i have used scrapebox to scrape me a HUUGEE List, (1 billion+).
Those are all links extracted, and scraped backlinks out of spammed auto-approve links. Anyways the problem is i have removed all duplicate URLS, and also Duplicate Domains, and i still come to about 1.8 million links. I...