1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scrape All links from a domain?

Discussion in 'Black Hat SEO Tools' started by zacatictac, Sep 21, 2010.

  1. zacatictac

    zacatictac Power Member

    Joined:
    May 2, 2010
    Messages:
    597
    Likes Received:
    754
    Occupation:
    SEO
    Location:
    Metaverse
    This may be a dumb question. i have scrape box and a list of 200k auto approved blogs and i want to do a blast of all my inner links not just my main domain name. how do i go about scraping all of my blogs links? i thought this would be easy to do but i cant figure it out. thanks.
     
  2. thachcaodotcom

    thachcaodotcom Junior Member

    Joined:
    Oct 21, 2009
    Messages:
    121
    Likes Received:
    151
    Try an webbase XML sitemap generationlike this one http://www.xml-sitemaps.com/ ( or offline sitemap software...)and use html or txt format.
     
    • Thanks Thanks x 1
  3. Florist88

    Florist88 Newbie

    Joined:
    Jul 24, 2009
    Messages:
    43
    Likes Received:
    7
    You can use the site: command in scrapebox's Harvester field, your URL in the Keywords field and then click the 'Start Harvesting' button so you will get all the inner links which are indexed by G or you can use the Scrapebox sitemap scraper addon (presuming you have a sitemap)