Try Sitemap Scraper Add-On to harvest all pages on Given Website.
Add on to what?
Thanxxx[/QUOTE]
Sitemap Scraper is a Scrapebox Add-on which Harvests all urls from given website's sitemap (.xml or .axd)
How to Use this Add-On?
Open Notepad
Enter the Site's URL in following format
http://www.thesitewhichyouwanttorip.com/sitemap.xml
Save it and load it up in Sitemap Scraper Add-On
Make Sure to Select "Deep Harvest" Checkbox and Press Start.
Thats It.
PS: You Need Scrapebox to do this.