1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Best Proxy Scraper Ever Made

Discussion in 'Black Hat SEO Tools' started by Gatorowns, Apr 4, 2012.

  1. Gatorowns

    Gatorowns Newbie

    Joined:
    Jan 31, 2009
    Messages:
    14
    Likes Received:
    34
    Occupation:
    Programmer
    I've decided to release my project to the public..

    Enjoy extraction :)

    Edit:
    You need your vb6 runtime files installed to run this application. I've uploaded it as an attachment. This will keep you from getting MSINET component errors on application launch.
     

    Attached Files:

    • Thanks Thanks x 28
    Last edited: Apr 4, 2012
  2. MAC-11

    MAC-11 Junior Member

    Joined:
    Feb 3, 2012
    Messages:
    168
    Likes Received:
    96
    Occupation:
    marketing/ sales
    Location:
    Canada
    Going to test it out, i hope its good, i hate proxy switcher and proxy goblin.
     
  3. exceeds

    exceeds Regular Member

    Joined:
    Oct 3, 2011
    Messages:
    265
    Likes Received:
    66
    it's nice if you could provide viruses scanner
     
  4. Gatorowns

    Gatorowns Newbie

    Joined:
    Jan 31, 2009
    Messages:
    14
    Likes Received:
    34
    Occupation:
    Programmer
    it won't let me post links yet.
     
  5. kickapooh

    kickapooh Regular Member

    Joined:
    Apr 16, 2010
    Messages:
    431
    Likes Received:
    844
    VirusTotal Results:
    Code:
    https://www.virustotal.com/file/5537dee41dc6a5e8338be7f9cbfdd228fdd43bac90a6617fa640f83e7a462342/analysis/
    Got 2 hits but its 100% clean.

    This is the best proxy tool I've ever used hands down. I know the OP from way back in the day and his software is top-notch.

    This is a tool that could easily sell for $100. I can't believe he released it for free!!

    TY man!! I donated some PayPal funds your way as well.
     
    • Thanks Thanks x 2
    Last edited: Apr 4, 2012
  6. tr4d3

    tr4d3 Newbie

    Joined:
    Dec 25, 2008
    Messages:
    42
    Likes Received:
    2
    hey man, good tool, my opinion only extract only past 24 hours , only anon, remove duplicates proxies, this project is great.
     
  7. Gatorowns

    Gatorowns Newbie

    Joined:
    Jan 31, 2009
    Messages:
    14
    Likes Received:
    34
    Occupation:
    Programmer
    Can I get some more feed back on this.
     
  8. Zallia

    Zallia Newbie

    Joined:
    Apr 8, 2012
    Messages:
    1
    Likes Received:
    0
    A friend is a loving companion at all times.
     
  9. smitha

    smitha Registered Member

    Joined:
    Oct 13, 2009
    Messages:
    61
    Likes Received:
    39
    Home Page:
    can u give the list of sites from where these proxys are leached
     
  10. mmaniac

    mmaniac Newbie

    Joined:
    Dec 17, 2009
    Messages:
    29
    Likes Received:
    8
    Occupation:
    web designer/developer
    Location:
    Internet
    Gatorowns, thank you very much for this awesome little tool. It's simple to use and works well.

    Tips for new users:
    1. lower the Checker value (default is 300) if you don't have huge bandwidth, so that you can browse internet or use other tools that depend on internet connection. I have 5Mbit connection, so I tried with value of 35 and program still checks proxies fast, but I can surf normally. Try with various values a few times and see what works best for you.
    2. You don't have to wait for checker to check all proxies, you can save good proxies to file anytime.

    Gatorowns, a few questions, if you don't mind:
    1. can you tell me what's accomplished with changing of Link Extract and URL grabber values in Settings. I tried to lower them considerably, because I don't need that much proxies, but program still extracted roughly the same number of proxies.
    2. is there a way to automate tool via arguments when you execute program? I'll try with Auto It. My goal is to have a few dozens of working proxies all the time.
     
  11. Gatorowns

    Gatorowns Newbie

    Joined:
    Jan 31, 2009
    Messages:
    14
    Likes Received:
    34
    Occupation:
    Programmer
    The link extractor and URL grabber value is the amount of open threads it uses to parse through links or parse through pages extracting proxys.. raising and lowering these are mainly dependable on the system specs you are running.. the reason why I added it is some people use old xp machines with 512mb of ram which using to many open threads all extraction in different arrays would crash the app. as far as automated.. I could make it save the goods automatically to a certain file and refresh the list every so often therefore you would never have to stop it.. i'll probably update it and add this for you.
     
    • Thanks Thanks x 1
  12. mmaniac

    mmaniac Newbie

    Joined:
    Dec 17, 2009
    Messages:
    29
    Likes Received:
    8
    Occupation:
    web designer/developer
    Location:
    Internet
    Thank you for answering my questions so quick. Adding the functionality you mentioned would be perfect!
     
  13. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,295
    Likes Received:
    8,715
    sup gator - ive known this guy since 2004
    anyone try google romanware - he use to work with a
    guy called marcus, i bought just about every tool gator
    ever made as well as marcus. when i say this guy knows
    his stuff - HE KNOWS HIS STUFF -
    i use to love using marcuses stuff but he stopped answering
    just about anyone these days, even tools i bought that required
    re - activation i tried to get the guy to add them back online
    several times over the past 2-3 yrs, the guy never replied.
    so i binned the tools.

    my favorite tool by gator rsl.

    now as as anyone knows when it comes to public http proxies
    u never get more than 4-5k working per test.
    question gator, when i link scan with scrapebox and grab 100
    links of the day which takes maybe 2/3 mins. add 2/3 mins on that
    to scrape them, i usually get 7/8k public http proxies - 10 mins to bleach to get
    5k working public http. this method uses 2 tools and takes about the same time
    as your new tool and gets 4x more working proxies.

    my only concern is i did a full leech 330 urls and pulled over 78k proxies
    now even i no only less than 5k http will work which will make
    90% of the test invallid.
    any way to refine the tool only searching links of the day. test is running
    will post results of working proxies and how long it took

    total time to leech all 330 links - test 78k proxies 20 mins.
    total working proxies in the tool 1246

    you did ask for feedback

    as things stand right now, as a freebie for people its great but i no you
    can do better, alot better. 1200 proxies from 78k is a low result with
    20 mins taken especially when the same method applied through grabbing
    links through scrapebox/leeching the links/testing in bleach takes the same
    ammount of time but yields 4-5k working http proxies.

    gives u something to think about..
     
    Last edited: Apr 8, 2012
  14. Gatorowns

    Gatorowns Newbie

    Joined:
    Jan 31, 2009
    Messages:
    14
    Likes Received:
    34
    Occupation:
    Programmer
    I could make it compile the links but as far as a static the links will change every 3 minutes since the base list changes every 3 minutes.. therefore every 3 minutes the link base would be different
     
    • Thanks Thanks x 1
  15. Gatorowns

    Gatorowns Newbie

    Joined:
    Jan 31, 2009
    Messages:
    14
    Likes Received:
    34
    Occupation:
    Programmer
    I use a search vulnerability exploit I found to bypass engine bans to retrieve links. The only way that this could be fee-sable would be maybe a way to manipulate the engines to pulling the newest cache links spidered. If I can do this it would cause the most updated lists to leech. I'll look into it to see what I can do. I haven't really gotten any donations or charity for this project so between real life and free time my motivation is limited. I'll see what I can do.
     
    • Thanks Thanks x 1
  16. proxyblaze

    proxyblaze Jr. VIP Jr. VIP

    Joined:
    Oct 26, 2011
    Messages:
    822
    Likes Received:
    139
    Occupation:
    Technical Assistant (Wipro)
    Location:
    ProxyBlaze.com
    Home Page:
    Hey gator, nice tool. Adding you +Rep
    Thanks
     
  17. Gatorowns

    Gatorowns Newbie

    Joined:
    Jan 31, 2009
    Messages:
    14
    Likes Received:
    34
    Occupation:
    Programmer
    Thanks..


    Also Proxygo.. I was able to manipulate the engine to return 24 hour old links.. i'm running tests now to see if the engine bans doing it this way.. if it does you would have to grab links using proxys which isn't a option in my opinion.
     
  18. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,295
    Likes Received:
    8,715
    gator i own so many tools - if you follow me
    i have my favorites over the years .

    dont get me wrong this as a freebie for users who
    cant get many is probably great for them and i say
    good of you to post it.

    actually when i think back i remember you from 2002
    and i no you remember me. check your pms bro.

    u should have been selling something like rsl here yrs ago
    when it worked well, 240k members here ude have made
    100x more here selling that as u ever did at romanware
    good to see your still around
     
  19. SweTech

    SweTech Power Member

    Joined:
    Apr 22, 2011
    Messages:
    620
    Likes Received:
    2,608
    Occupation:
    SEO freelancer
    Location:
    Stockholm, Sweden
    Thank you for a great share!

    +rep
     
  20. Gatorowns

    Gatorowns Newbie

    Joined:
    Jan 31, 2009
    Messages:
    14
    Likes Received:
    34
    Occupation:
    Programmer
    It's not letting me edit my original post.. Donno why but a mod can change the links up if they want

    Update Version 2.1

    * Added auto save option for users wanting to have a steady list refreshing itself so often.
    * Optimized the engines function to where to only pulls links for sites updated in the past 24 hours. Although this will give you faster, newer, proxy... it also kicks back alot of dupes which the application has to filter out.
     

    Attached Files:

    • Thanks Thanks x 3