Recently I scrape links via Gscraper, it works great. I can scrape 8 millions per day, but most of the links are duplicated, after removing duplicated links, i can only get 1-2Million unique domains.
Any tips to get more unique domains? Thanks.
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.
