How do you get all the links from one domain? (in SB?)

onething1

Junior Member
Joined
Sep 10, 2010
Messages
116
Reaction score
2
Say you trim to root in scrapebox. The link extractor addon only gives the links that go outwards from and towards that link. So this is not what I'm looking for. I just want all the urls that are under that domain. How, dear Lord, how does one do this? thx in advance for feedback
 
You have two options. My favorite is to trim domains to root and add prefix (sitemap) to them. For wordpress and movabletype use prefix "/sitemap.xml" and for blogengine "/sitemap.axd" and use sitemap scraper.
Another option is to harvest inbound links with deep crawl but this is less effective.
 
you could try harvest site:domain.com and get all links from there, but doesnt link extractor do inbound links too? (select internal instead of external) im not sure though, ive never tried it
 
Back
Top