1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to scrape whole website external links?

Discussion in 'Black Hat SEO' started by culling, Dec 12, 2016.

  1. culling

    culling Registered Member

    Joined:
    Apr 7, 2016
    Messages:
    79
    Likes Received:
    5
    Hello. I own a scrapebox license.
    Is it possible to scrape all external backlinks of a whole single website?
    If I use the addon Link Extractor it seems this addon only scrape external link from the homepage. How can I let it scrape the whole website?
     
  2. bolkyaresha

    bolkyaresha Registered Member

    Joined:
    Dec 12, 2016
    Messages:
    77
    Likes Received:
    2
    Gender:
    Male
    xenu link sleuth
     
  3. Peter Ngo

    Peter Ngo Jr. VIP Jr. VIP

    Joined:
    Apr 23, 2013
    Messages:
    2,105
    Likes Received:
    1,708
    Occupation:
    I browse BHW for a living
    Location:
    The Internet
    there are a few ways to do it with scrapebox, if the site you are scraping is not that big, you can use Get Links By Crawling features in scrapebox to crawl all URls of the site.

    Then use link extractor addon, load all the crawled URLs in, then extract external links, should work perfectly.

    If the site has like 1-2 million indexed pages, you probably will have to scrape them using tons of keywords.
     
    • Thanks Thanks x 1
  4. culling

    culling Registered Member

    Joined:
    Apr 7, 2016
    Messages:
    79
    Likes Received:
    5
    Thank you...