1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Definition of ScrapeBox proxy

Discussion in 'Proxies' started by Petrel, Mar 29, 2010.

  1. Petrel

    Petrel Registered Member

    Joined:
    Aug 27, 2009
    Messages:
    62
    Likes Received:
    10
    What sort of test must a proxy pass before it is considered a ScrapeBox proxy? I don't have a copy, so I can't find it myself.

    I don't think it's the Google test, that's way too stringent.

    It's not a honeypot test as none of them are large enough.

    Maybe an Akismet test?
     
  2. bizminder

    bizminder Registered Member

    Joined:
    Mar 16, 2010
    Messages:
    68
    Likes Received:
    3
    Scrape Box Proxy is where you will find thousands of links at the click of a button.
     
  3. kendra

    kendra Power Member

    Joined:
    Aug 12, 2009
    Messages:
    538
    Likes Received:
    334
    Yes I personally think that a Scrapebox Proxy should pass an Akismet test, though in reality not all of them do.
     
  4. justone

    justone Elite Member

    Joined:
    Oct 12, 2008
    Messages:
    1,516
    Likes Received:
    1,037
    Occupation:
    -
    Location:
    Europe
    For my project proxycollective.com it has to pass the google proxy detection, if google does not detect it as a proxy it can be used for automated queries.
     
  5. Petrel

    Petrel Registered Member

    Joined:
    Aug 27, 2009
    Messages:
    62
    Likes Received:
    10
    I did not realize that Google test meant making a query. (I thought it was searching to see if the IP would be found on a proxy list)

    I've been doing some testing. 38.110.6.40:8080 is a fast anonymous proxy which was found on 2/7/10 (%99 uptime). I get "about 879" for the search: 38.110.6.40 proxy. It is blocked on Akismet.

    However, I only got 1 captcha request out of around 4 queries. Also, the query itself seems to make a difference. The query obama is more likely to be accepted than 1..200. Unless I'm doing something wrong, using Google as a test doesn't seem too reliable...
     
  6. justone

    justone Elite Member

    Joined:
    Oct 12, 2008
    Messages:
    1,516
    Likes Received:
    1,037
    Occupation:
    -
    Location:
    Europe
    It seems to work not too bad.
    If you've a better idea I'd be glad to hear.
     
    • Thanks Thanks x 1
  7. Petrel

    Petrel Registered Member

    Joined:
    Aug 27, 2009
    Messages:
    62
    Likes Received:
    10
    I compared the two tests using a larger number of proxies. Testing only a handful of proxies was misleading. As you say, the Google test is much better.

    Out of 100 proxies that passed the Akismet test, only 11 passed ScrapeBox's checker (thanks to bassist for the test). Google test: Out of the hundred, 59 were counted as proxies and 19 were accepted. Due to a small oversight, 19 is an overstatement. I was unable to test the other 22.

    If anybody's interested, I can write back when I more accurately test the whole db.

    My Google query:
    Code:
    http://www.google.com/search?hl=en&source=hp&q=1..200&btnG=Google%2BSearch&aq=f&aqi=&aql=&oq=1..200&gs_rfai=
    
     
  8. DenRomano

    DenRomano Newbie

    Joined:
    Feb 10, 2010
    Messages:
    24
    Likes Received:
    0
    Location:
    Las Vegas, NV
    Home Page:
    please do, I would like to figure out a way to scrape proxies that can be used for posting (i.e. passes Akismet)
     
  9. g111k

    g111k Regular Member

    Joined:
    Jul 23, 2009
    Messages:
    263
    Likes Received:
    193
    Sry for being noob with proxies, but what do you guys mean by Google test? How do you test to see if Google detects it as a proxy or not?
     
  10. Petrel

    Petrel Registered Member

    Joined:
    Aug 27, 2009
    Messages:
    62
    Likes Received:
    10
    Google test: successful Google query. To easily test this you could, for example, query nyt. If nytimes is in the page that gets returned to you, the query is successful.

    A confirmation-- on Warriorforum, SB's owner says that SB tests proxies by doing a Google query.

    For the Akismet test you'll need to get an API key. Then you'll be able to send the proxy IP to Akismet for testing. Granted, Akismet also relies on other data to catch spam, but good portion of these IP's are denied from the beginning.

    Some stats:

    42/210 (20%) Akismet proxies passed the Google test
    356/1493 (24%) Non-transparent HTTP proxies pass the Google test
    109/325 (34%) SOCKS proxies pass the Google test