Custom footprint to harvest all the pages of a given website?

omoxx · Sep 4, 2010

Is there a custom footprint to harvest all the pages of a given website?
Thank you

bezopravin · Sep 4, 2010

Try Sitemap Scraper Add-On to harvest all pages on Given Website.

omoxx · Sep 4, 2010

bezopravin said:
Try Sitemap Scraper Add-On to harvest all pages on Given Website.

Add on to what?
Thanxxx

royalmice · Sep 4, 2010

Not sure if it is what you are looking for but i recentely posted a extensive list of footprints over here : http://www.blackhatworld.com/blackhat-seo/black-hat-seo-tools/232492-usefull-lost-footprints-scrapping-urls.html

bakxos · Sep 4, 2010

Code:

site:[URL="http://www.site.com/"]www.site.com[/URL]

http://www.site.com

bezopravin · Sep 4, 2010

omoxx said:
Add on to what?
Thanxxx[/QUOTE]

Sitemap Scraper is a Scrapebox Add-on which Harvests all urls from given website's sitemap (.xml or .axd)

How to Use this Add-On?

Open Notepad

Enter the Site's URL in following format

http://www.thesitewhichyouwanttorip.com/sitemap.xml

Save it and load it up in Sitemap Scraper Add-On

Make Sure to Select "Deep Harvest" Checkbox and Press Start.

Thats It.

PS: You Need Scrapebox to do this.

omoxx · Sep 9, 2010

I enter "site:mysite.com" in the harvester browser, > Custom footprint>Yahoo .

Then I enter "mysite.com" in the KWs window>Start Harvesting.

"Automatically Remove Duplicate Domains" checked? If so, uncheck it.

trakker · Sep 26, 2010

Sorry for a dumb question, but this scrapebox add-on just harvests the URL of a given site, correct?

Is there anything that scrapes a site or blogs posts content?

Custom footprint to harvest all the pages of a given website?

omoxx

Regular Member

bezopravin

BANNED

omoxx

Regular Member

royalmice

BANNED

bakxos

Regular Member

bezopravin

BANNED

omoxx

Regular Member

trakker

Newbie

Main Menu

Marketplace

Making Money

BlackHatWorld

Other