Hinkys
Power Member
- Mar 3, 2012
- 756
- 571
Hey guys,
It's been a while since I set my mind to do this but there was always something better to do. But it's finally been done!
This should end any "CB vs CS" debate that's been going on around here for a long time. Also, I'll try to explain what I did as best as I can so everyone can replicate these tests if they wish to do so.
So what exactly have I done here?
1. Compiled 5 lists using the "Identified" folder from my GSA SER and loads of randomization:
2. Created 4 projects in SER for each of these lists:
The general idea for each list (test) is the following:
If you're interested in tests for specific types of links (Social Bookmarks, Web 2.0s & Wikis)
you can find them in the original blog post:
While this all seems pretty close, let's put things into perspective.
First we need to look and see that "DeathByCaptcha" submitted 7,074 while "NoCaptcha" project submitted 4,446 links in total. From this we can conclude that around 2,628 sites have captcha. Now we take our CS & CB projects and subtract those 4,446 links that don't have any captcha.
After doing so, we get our final results:
"Captcha Breaker" successfully posted to 2,097 sites with captcha = 80% success rate (2,097 / 2,628)
"Captcha Sniper" successfully posted to 1,452 sites with captcha = 55% success rate (1,452 / 2,628)
Speed Test:
Test #2 was also a speed test and here is how long it took each project to go through the list:
"NoCaptcha": 30min
"CaptchaBreaker": 33min
"CaptchaSniper": 42min
"DeathByCaptcha": 45min
Final Words
The thing that sticks out like a sore thumb is the fact that CB got dangerously close to DBC. And that's with skipping all hard to solve captcha! I didn't expect the 2 bots to get even 40% of links that DBC had. Well you learn something new everyday and after running this test I learned that I should stop using pay-per-captcha services altogether, except maybe for very important tier 1 links. (And if you're building those links with a bot, chances are it's not THAT important)
So save your money guys.
Fact #2 - Captcha Breaker project had more successful submissions
Fact #3 - Captcha Breaker project went through the list faster than Captcha Sniper project
Fact #4 - Captcha Sniper rarely gets updated
Fact #5 - Captcha Breaker gets updated weekly, sometimes even daily
Fact #6 - Captcha Sniper has some stability issues
Fact #7 - Captcha Sniper is cheaper than Captcha Breaker
It's been a while since I set my mind to do this but there was always something better to do. But it's finally been done!
This should end any "CB vs CS" debate that's been going on around here for a long time. Also, I'll try to explain what I did as best as I can so everyone can replicate these tests if they wish to do so.
So what exactly have I done here?
1. Compiled 5 lists using the "Identified" folder from my GSA SER and loads of randomization:
- Random mix #1 (10k sites - 100+ platforms)
- Random mix #2 (10k sites - 100+ platforms)
- Social Bookmarks (2,5k sites - Pligg, Phpdug, Scuttle)
- Web 2.0s (2,5k sites - Dolphin, Elgg, Jcow, Oxwall, PHPFox, PHPizabi)
- Wikis (2,5k sites - DokuWiki, MediaWiki, TikiWiki, MoinMoin, WikkaWiki)
2. Created 4 projects in SER for each of these lists:
- "DeathByCaptcha" - Retry captcha 1 time
- Serves as a control project to see what is the max # of sites we can post to
- "Captcha Breaker" - Retry captcha 4 times
- "Captcha Sniper" - Retry captcha 4 times
- "No captcha" - Skips all captcha
- So we can know which sites don't use captchas and keep them out of the equation.
You might argue that setting the DBC's project captcha retries to 1 has lowered the max number of links it will create. This is probably true but remember that this test wasn't created to test how well DBC compares to the bots but rather to compare CS & CB side-by-side. Also, I imagine most people using "pay-per-captcha" service set the retries to 1-2 since anything more than that is hardly cost-efficient.
The general idea for each list (test) is the following:
- Use GSA SER for posting
- By using content scraped from very similar keywords using the same software, we minimize the chance that content is affecting the results
- We're only using the number of submitted links as verification has nothing to do with captcha solving
- Take the links from "DeathByCaptcha" project as the maximum number of links you could expect from other projects
- Subtract the "NoCaptcha" project links from the "DeathBycaptcha" links to get the number of sites that use captcha
- Calculate the success rate for CS & CB projects based on that number
The results:
If you're interested in tests for specific types of links (Social Bookmarks, Web 2.0s & Wikis)
you can find them in the original blog post:
Code:
[URL]http://johngrginov.com/captcha-breaker-vs-captcha-sniper-ultimate-test/[/URL]While this all seems pretty close, let's put things into perspective.
First we need to look and see that "DeathByCaptcha" submitted 7,074 while "NoCaptcha" project submitted 4,446 links in total. From this we can conclude that around 2,628 sites have captcha. Now we take our CS & CB projects and subtract those 4,446 links that don't have any captcha.
After doing so, we get our final results:
"Captcha Breaker" successfully posted to 2,097 sites with captcha = 80% success rate (2,097 / 2,628)
"Captcha Sniper" successfully posted to 1,452 sites with captcha = 55% success rate (1,452 / 2,628)
Speed Test:
Test #2 was also a speed test and here is how long it took each project to go through the list:
"NoCaptcha": 30min
"CaptchaBreaker": 33min
"CaptchaSniper": 42min
"DeathByCaptcha": 45min
Final Words
The thing that sticks out like a sore thumb is the fact that CB got dangerously close to DBC. And that's with skipping all hard to solve captcha! I didn't expect the 2 bots to get even 40% of links that DBC had. Well you learn something new everyday and after running this test I learned that I should stop using pay-per-captcha services altogether, except maybe for very important tier 1 links. (And if you're building those links with a bot, chances are it's not THAT important)
So save your money guys.
Since I don't want to be accused of bashing someone's product, I'll simply summarize what I picked up from this test and what I know from experience so you can take what you want from this.
Fact #1 - Both projects used VERY SIMILAR scraped content (think "chicken soup recipe" vs "beef jerkey recipe")
Fact #2 - Captcha Breaker project had more successful submissions
Fact #3 - Captcha Breaker project went through the list faster than Captcha Sniper project
Fact #4 - Captcha Sniper rarely gets updated
Fact #5 - Captcha Breaker gets updated weekly, sometimes even daily
Fact #6 - Captcha Sniper has some stability issues
Fact #7 - Captcha Sniper is cheaper than Captcha Breaker
Last edited:
