DigitalKing
Newbie
- Dec 17, 2018
- 5
- 5
I'm using HTTrack to download small business websites, but for like 1/100 sites it will either be a massive directory website with millions of pages or a site that has urls with weird GET variables and what not and, consequently, HTTrack will get stuck on that website for days or infinitely.
I tried searching online for hours but can't find the answer to this anywhere... I'm sure I'm not alone. Isn't there a way to limit it to like max 500 URLs per domain? Maybe there's another program that could do this?
Thanks
I tried searching online for hours but can't find the answer to this anywhere... I'm sure I'm not alone. Isn't there a way to limit it to like max 500 URLs per domain? Maybe there's another program that could do this?
Thanks