Definition of ScrapeBox proxy

P

Petrel

Registered Member

Aug 27, 2009

62

10

• Mar 29, 2010

• #1

What sort of test must a proxy pass before it is considered a ScrapeBox proxy? I don't have a copy, so I can't find it myself.

I don't think it's the Google test, that's way too stringent.

It's not a honeypot test as none of them are large enough.

Maybe an Akismet test?

 

B

bizminder

Registered Member

Mar 16, 2010

68

3

• Mar 29, 2010

• #2

Scrape Box Proxy is where you will find thousands of links at the click of a button.

 

K

kendra

BANNED

Aug 12, 2009

535

339

• Mar 30, 2010

• #3

Petrel said:

Maybe an Akismet test?

Click to expand...

Yes I personally think that a Scrapebox Proxy should pass an Akismet test, though in reality not all of them do.

 

justone

BANNED

Oct 12, 2008

1,520

1,054

• Mar 30, 2010

• #4

For my project proxycollective.com it has to pass the google proxy detection, if google does not detect it as a proxy it can be used for automated queries.

 

P

Petrel

Registered Member

Aug 27, 2009

62

10

• Mar 30, 2010
• Thread Starter Thread Starter

• #5

I did not realize that Google test meant making a query. (I thought it was searching to see if the IP would be found on a proxy list)

I've been doing some testing. 38.110.6.40:8080 is a fast anonymous proxy which was found on 2/7/10 (%99 uptime). I get "about 879" for the search: 38.110.6.40 proxy. It is blocked on Akismet.

However, I only got 1 captcha request out of around 4 queries. Also, the query itself seems to make a difference. The query obama is more likely to be accepted than 1..200. Unless I'm doing something wrong, using Google as a test doesn't seem too reliable...

 

justone

BANNED

Oct 12, 2008

1,520

1,054

• Mar 31, 2010

• #6

It seems to work not too bad.
If you've a better idea I'd be glad to hear.

 

P

Petrel

Registered Member

Aug 27, 2009

62

10

• Mar 31, 2010
• Thread Starter Thread Starter

• #7

I compared the two tests using a larger number of proxies. Testing only a handful of proxies was misleading. As you say, the Google test is much better.

Out of 100 proxies that passed the Akismet test, only 11 passed ScrapeBox's checker (thanks to bassist for the test). Google test: Out of the hundred, 59 were counted as proxies and 19 were accepted. Due to a small oversight, 19 is an overstatement. I was unable to test the other 22.

If anybody's interested, I can write back when I more accurately test the whole db.

My Google query:

Code:

http://www.google.com/search?hl=en&source=hp&q=1..200&btnG=Google%2BSearch&aq=f&aqi=&aql=&oq=1..200&gs_rfai=

 

D

DenRomano

Newbie

Feb 10, 2010

24

0

• Apr 1, 2010

• #8

please do, I would like to figure out a way to scrape proxies that can be used for posting (i.e. passes Akismet)

 

g111k

Regular Member

Jul 23, 2009

264

199

• Apr 1, 2010

• #9

Sry for being noob with proxies, but what do you guys mean by Google test? How do you test to see if Google detects it as a proxy or not?

 

P

Petrel

Registered Member

Aug 27, 2009

62

10

• Apr 2, 2010
• Thread Starter Thread Starter

• #10

Google test: successful Google query. To easily test this you could, for example, query nyt. If nytimes is in the page that gets returned to you, the query is successful.

A confirmation-- on Warriorforum, SB's owner says that SB tests proxies by doing a Google query.

For the Akismet test you'll need to get an API key. Then you'll be able to send the proxy IP to Akismet for testing. Granted, Akismet also relies on other data to catch spam, but good portion of these IP's are denied from the beginning.

Some stats:

42/210 (20%) Akismet proxies passed the Google test
356/1493 (24%) Non-transparent HTTP proxies pass the Google test
109/325 (34%) SOCKS proxies pass the Google test