How to get unique urls when blogs are on subdomains?

Discussion in 'Black Hat SEO Tools' started by Satyren, May 29, 2015.

  1. Satyren

    Satyren Power Member

    Joined:
    Nov 29, 2009
    Messages:
    501
    Likes Received:
    599
    Location:
    EU
    I'm scraping community-site where every user have gets their own subdomain.
    So my scraped list looks like this:
    Code:
    adam.url.com/post1
    adam.url.com/post2
    john.url.com/post1
    john.url.com/post2
    julia.url.com/post1
    julia.url.com/post2
    Scrapebox can, as far as I know, only help me with cleaning out non-unique urls. So in a situation like this, how can I fix this? I don't want multiple urls from the same user.

    Thanks in advance,
    S.
     
  2. xrfanatic

    xrfanatic Regular Member

    Joined:
    Aug 28, 2010
    Messages:
    419
    Likes Received:
    176
    Location:
    http://bit.ly/slb64
    Home Page: