scraping domain.com will give you more site links
coz it includes domain.com /directory1 domain.com/directory2
it will include all the directories listed by particular SE
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.