3 Million URLS for SB cleaning out HD

Discussion in 'Black Hat SEO' started by Bostoncab, Apr 6, 2011.

  1. Bostoncab

    Bostoncab Elite Member

    Dec 31, 2009
    Likes Received:
    pain in the ass cabbie
    So I was just cleaning out my windows PC and I had shit tons of txt files with urls in a Scrapebox folder. Some are from auto approve lists some are from lists I scraped myself some.. I have no friggen idea what they were. So using my new found education in removing duplicates with Ubuntu I sorted them all into one txt file with just under 3 million unique urls. No idea how many different domains they come from. Looks like lots of repeats when I was quickly scanning the file. Could be of use to someone else just starting out messing with SB so I figured I would post it. If it helps you throw me some thanks or I could always use some new proxies.

    • Thanks Thanks x 1
    Last edited: Apr 6, 2011