1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to get unique urls when blogs are on subdomains?

Discussion in 'Black Hat SEO Tools' started by Satyren, May 29, 2015.

  1. Satyren

    Satyren Regular Member

    Joined:
    Nov 29, 2009
    Messages:
    496
    Likes Received:
    598
    Location:
    EU
    I'm scraping community-site where every user have gets their own subdomain.
    So my scraped list looks like this:
    Code:
    adam.url.com/post1
    adam.url.com/post2
    john.url.com/post1
    john.url.com/post2
    julia.url.com/post1
    julia.url.com/post2
    Scrapebox can, as far as I know, only help me with cleaning out non-unique urls. So in a situation like this, how can I fix this? I don't want multiple urls from the same user.

    Thanks in advance,
    S.
     
  2. xrfanatic

    xrfanatic Jr. VIP Jr. VIP

    Joined:
    Aug 28, 2010
    Messages:
    419
    Likes Received:
    176
    Location:
    http://bit.ly/slb64
    Home Page: