1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to find pages from a list with 300 domains

Discussion in 'Black Hat SEO' started by banel, Dec 14, 2010.

  1. banel

    banel Regular Member

    Joined:
    Mar 30, 2010
    Messages:
    287
    Likes Received:
    16
    I got a list with 300 domains. I want to get at least 20-30 pages from all domains. I can't find a solutin, anyone has any idea ?
     
  2. noermanto

    noermanto Regular Member

    Joined:
    Nov 18, 2009
    Messages:
    305
    Likes Received:
    288
    Occupation:
    None
    Location:
    # JKT #
    Home Page:
    Just use their sitemap, incase hxxp://domain1.com
    get the hxxp://domain1.co/sitemap.xml

    Convert sitemap into text links.
     
  3. banel

    banel Regular Member

    Joined:
    Mar 30, 2010
    Messages:
    287
    Likes Received:
    16
    It's a list with 300 domains... how i'm gonna do that manually? I was hoping that is a software that i can use.
     
  4. banel

    banel Regular Member

    Joined:
    Mar 30, 2010
    Messages:
    287
    Likes Received:
    16
    Any idea ? Help please.
     
  5. Jesperj

    Jesperj Power Member

    Joined:
    Sep 10, 2010
    Messages:
    502
    Likes Received:
    347
    Occupation:
    Web Designer
    Location:
    Far, Far away
    Home Page:
    Banel give me the list and i will do it for you.
     
  6. andreyg13

    andreyg13 Jr. VIP Jr. VIP

    Joined:
    Nov 13, 2009
    Messages:
    915
    Likes Received:
    1,774
    Occupation:
    SEO
    Location:
    http://seoshark.org
    Home Page:
    just open in notepad and do replace http:// with site:
    now load the new list with site: in front into scrapebox keyword list , tick custom footprint and leave blank and hit harvest. ;)
     
  7. mazgalici

    mazgalici Supreme Member

    Joined:
    Jan 2, 2009
    Messages:
    1,489
    Likes Received:
    881
    Home Page:
    I can write you a script to retrive 10 urls for each domain
     
    Last edited: Dec 15, 2010
  8. banel

    banel Regular Member

    Joined:
    Mar 30, 2010
    Messages:
    287
    Likes Received:
    16
    Thanks guys. Problem solved.

    P.S.: Din 4 raspunsuri 2 au fost de la compatrioti :D. Ms baieti.