What sort of test must a proxy pass before it is considered a ScrapeBox proxy? I don't have a copy, so I can't find it myself.

I don't think it's the Google test, that's way too stringent.

It's not a honeypot test as none of them are large enough.

Maybe an Akismet test?

Scrape Box Proxy is where you will find thousands of links at the click of a button.

Originally Posted by Petrel

Maybe an Akismet test?

Yes I personally think that a Scrapebox Proxy should pass an Akismet test, though in reality not all of them do.

For my project proxycollective.com it has to pass the google proxy detection, if google does not detect it as a proxy it can be used for automated queries.

I did not realize that Google test meant making a query. (I thought it was searching to see if the IP would be found on a proxy list)

I've been doing some testing. 38.110.6.40:8080 is a fast anonymous proxy which was found on 2/7/10 (%99 uptime). I get "about 879" for the search: 38.110.6.40 proxy. It is blocked on Akismet.

However, I only got 1 captcha request out of around 4 queries. Also, the query itself seems to make a difference. The query obama is more likely to be accepted than 1..200. Unless I'm doing something wrong, using Google as a test doesn't seem too reliable...

It seems to work not too bad.
If you've a better idea I'd be glad to hear.

I compared the two tests using a larger number of proxies. Testing only a handful of proxies was misleading. As you say, the Google test is much better.

Out of 100 proxies that passed the Akismet test, only 11 passed ScrapeBox's checker (thanks to bassist for the test). Google test: Out of the hundred, 59 were counted as proxies and 19 were accepted. Due to a small oversight, 19 is an overstatement. I was unable to test the other 22.

If anybody's interested, I can write back when I more accurately test the whole db.

My Google query:

Code:

http://www.google.com/search?hl=en&source=hp&q=1..200&btnG=Google%2BSearch&aq=f&aqi=&aql=&oq=1..200&gs_rfai=

please do, I would like to figure out a way to scrape proxies that can be used for posting (i.e. passes Akismet)

Sry for being noob with proxies, but what do you guys mean by Google test? How do you test to see if Google detects it as a proxy or not?

Google test: successful Google query. To easily test this you could, for example, query nyt. If nytimes is in the page that gets returned to you, the query is successful.

A confirmation-- on Warriorforum, SB's owner says that SB tests proxies by doing a Google query.

For the Akismet test you'll need to get an API key. Then you'll be able to send the proxy IP to Akismet for testing. Granted, Akismet also relies on other data to catch spam, but good portion of these IP's are denied from the beginning.

Some stats:

42/210 (20%) Akismet proxies passed the Google test
356/1493 (24%) Non-transparent HTTP proxies pass the Google test
109/325 (34%) SOCKS proxies pass the Google test