Custom footprint to harvest all the pages of a given website?

omoxx

Regular Member
Joined
Feb 21, 2008
Messages
346
Reaction score
18
Is there a custom footprint to harvest all the pages of a given website?
Thank you
 

bezopravin

BANNED
Joined
May 11, 2010
Messages
461
Reaction score
3,503
Try Sitemap Scraper Add-On to harvest all pages on Given Website.
 

royalmice

BANNED
Joined
Aug 23, 2007
Messages
1,186
Reaction score
990
Not sure if it is what you are looking for but i recentely posted a extensive list of footprints over here : http://www.blackhatworld.com/blackhat-seo/black-hat-seo-tools/232492-usefull-lost-footprints-scrapping-urls.html
 

bakxos

Regular Member
Joined
Aug 8, 2010
Messages
498
Reaction score
292
Code:
site:[URL="http://www.site.com/"]www.site.com[/URL]
http://www.site.com
 

bezopravin

BANNED
Joined
May 11, 2010
Messages
461
Reaction score
3,503
Add on to what?
Thanxxx[/QUOTE]

Sitemap Scraper is a Scrapebox Add-on which Harvests all urls from given website's sitemap (.xml or .axd)

How to Use this Add-On?

Open Notepad

Enter the Site's URL in following format

http://www.thesitewhichyouwanttorip.com/
sitemap.xml

Save it and load it up in Sitemap Scraper Add-On

Make Sure to Select "Deep Harvest" Checkbox and Press Start.

Thats It.

PS: You Need Scrapebox to do this.
 

omoxx

Regular Member
Joined
Feb 21, 2008
Messages
346
Reaction score
18
I enter "site:mysite.com" in the harvester browser, > Custom footprint>Yahoo .

Then I enter "mysite.com" in the KWs window>Start Harvesting.



"Automatically Remove Duplicate Domains" checked? If so, uncheck it.
 

trakker

Newbie
Joined
Jan 5, 2009
Messages
42
Reaction score
3
Sorry for a dumb question, but this scrapebox add-on just harvests the URL of a given site, correct?

Is there anything that scrapes a site or blogs posts content?
 
Top