This software is amazing. I just started using 100 semi-dedicated proxies and am harvesting at mach 1 speeds

.
The one issue I have is that strange massive URLs, primarily blogspot, seem to bug out the software. Check this out:
When people say that they press start and the action doesn't complete, it is likely these URLs that are stopping the process. For whatever reason, whenever SubRepo tries to process these urls (especially while checking page rank), the software either never ends or stops.
If you could find a way to filter these URLs out I'm sure it would fix a lot of problems. That strange weebly one could be removed by checking for an instance of "." in the URL before marking it as valid. The massive blogspot subdomains seem to have a space in them or something? Remove URLs automatically that have an instance of " " or find another way of detecting those things.
I'm sure it won't take more than 5 minutes to add the extra validation. I love SubRepo - just trying to make it even better

.