I purchased a 1-day trial yesterday and here is my quick review.
I started running it at 5 threads and the program was crawling at about a rate of 5-10k pages processed an hour. I bumped it up to 50 threads and and it was performing at about 20-27k pages processed an hour. I've got a VPS but decided to run it without one. At 50 threads my computer was obviously pretty slow but not unusable. It hasn't crashed once as of yet.
At first, I thought it would be hard to use as you can't input the urls you want to scrape directly in the program, having to add them to a notepad file instead. However, this really isn't an issue and is quick and easy to do. I also like how I don't have to wait until the scraping completely finishes to check the available domains the program has already found.
The ability to exclude domains containing certain words (I was getting spammy cialis, viagra, sports jerseys domains etc. at first) is a handy feature that will save you time.
The program pretty much does exactly what it says on the tin. It's an excellent tool for finding expired domains, but the results you get really do depend on the seed list used. Pretty much, garbage in garbage out. I've found a couple of domains that others may have registered but I passed on them, instead deciding to wait for the ones I feel are really worthwhile. As I get better with creating seed lists I'm sure I'll find a few.
It's also cool how there is no limit to the number of domains found, unlike a certain other tool on the market that does the same thing, although the ability to use google queries like the other program would be a pretty nice touch if it was added.
I'm using the free Moz API but am thinking of getting a paid account, as you'll obviously find a hell of a lot more spammy domains than good ones, which PA and DA will not tell you about. Seeing moz trust as well would save you a bit of time so you can get a better idea of whether the domain is worth checking out or not. TF and CF would be even better, but using it with a tool like this would be very costly.
Anyway, nicely done OP.
Edit: Bad timing! It just crashed for the first time.
I started running it at 5 threads and the program was crawling at about a rate of 5-10k pages processed an hour. I bumped it up to 50 threads and and it was performing at about 20-27k pages processed an hour. I've got a VPS but decided to run it without one. At 50 threads my computer was obviously pretty slow but not unusable. It hasn't crashed once as of yet.
At first, I thought it would be hard to use as you can't input the urls you want to scrape directly in the program, having to add them to a notepad file instead. However, this really isn't an issue and is quick and easy to do. I also like how I don't have to wait until the scraping completely finishes to check the available domains the program has already found.
The ability to exclude domains containing certain words (I was getting spammy cialis, viagra, sports jerseys domains etc. at first) is a handy feature that will save you time.
The program pretty much does exactly what it says on the tin. It's an excellent tool for finding expired domains, but the results you get really do depend on the seed list used. Pretty much, garbage in garbage out. I've found a couple of domains that others may have registered but I passed on them, instead deciding to wait for the ones I feel are really worthwhile. As I get better with creating seed lists I'm sure I'll find a few.
It's also cool how there is no limit to the number of domains found, unlike a certain other tool on the market that does the same thing, although the ability to use google queries like the other program would be a pretty nice touch if it was added.
I'm using the free Moz API but am thinking of getting a paid account, as you'll obviously find a hell of a lot more spammy domains than good ones, which PA and DA will not tell you about. Seeing moz trust as well would save you a bit of time so you can get a better idea of whether the domain is worth checking out or not. TF and CF would be even better, but using it with a tool like this would be very costly.
Anyway, nicely done OP.
Edit: Bad timing! It just crashed for the first time.
Last edited:
