1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Proxy Multiply - can I use it without google search for more Proxies ?

Discussion in 'Proxies' started by goooral, Mar 12, 2013.

  1. goooral

    goooral Newbie

    Joined:
    Jan 27, 2012
    Messages:
    42
    Likes Received:
    31
    Occupation:
    SEO expert
    Home Page:
    Hi,

    Im testing PM. It seems ok, but from what I see it forces to search for more proxies when finishes scraping IPs from my list

    Its NOT what I need done :)

    I got my list with about 10 regulary updated urls. All I need now is PM to download those proxy (about 60k) and test all of those if they are google enabled and export google proxy to server.

    I had PG do that before but now its totally useless imho. Their support doesnt answer and it seems to be gone.

    Any way to have it done without scraping ?
     
    • Thanks Thanks x 1
    Last edited: Mar 12, 2013
  2. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,202
    Likes Received:
    8,689
    just remember with public scraped proxies the rule is
    that there is usually about 5k live at any given time.
    of that 5k maybe a couple of hundred are google passed
    so testing anything over 5/7k is a waste because 50-53k
    of a 60k list will be dead
     
    Last edited: Mar 13, 2013
  3. goooral

    goooral Newbie

    Joined:
    Jan 27, 2012
    Messages:
    42
    Likes Received:
    31
    Occupation:
    SEO expert
    Home Page:
    Thanks proxygo - im aware of that and that is why I need to solve this puzzle.

    I got like 50 - 60k proxies in all different lists.

    I need to download all of them and re-check them for google and anonimity
     
  4. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,202
    Likes Received:
    8,689
    what you need is if you intend to use a public scraper
    is only about 7-10k proxie test, this is the problem with public
    scrapers they scrape new and old proxies and u end up testing
    them all
     
  5. innozemec

    innozemec Jr. VIP Jr. VIP

    Joined:
    Aug 19, 2011
    Messages:
    5,288
    Likes Received:
    1,799
    Location:
    www.Indexification.com
    Home Page:
    in the settings i think there is an option to disable searching.. let me check now..


    edit: try disabling the feature "scrape proxies from search engines automatically after the initial proxy scrape"
     
  6. goooral

    goooral Newbie

    Joined:
    Jan 27, 2012
    Messages:
    42
    Likes Received:
    31
    Occupation:
    SEO expert
    Home Page:
    Its disabled, but it still scrapes. Also - it doesnt download all the proxy from the lists. I think Im gonna pass on Proxy Multiply as well ;) I might just use some proxy service with API.
     
  7. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,202
    Likes Received:
    8,689
    you should have bought scrapebox - it allows you to scrape
    links to grab proxies from, from the last 24hrs, then lets
    you save the links, and scrape the proxies of them 57$
     
  8. goooral

    goooral Newbie

    Joined:
    Jan 27, 2012
    Messages:
    42
    Likes Received:
    31
    Occupation:
    SEO expert
    Home Page:
    Proxygo - thanks - I got 3 scrapebox licenses ;) Every server running 5 - 10 instances of scrapebox on top of other stuff.

    I use the trick with searching valid proxy from last 24h, then using those sites as sources etc. All that is ok and I do that once in a while. Dont have so much time every day. Maintenance of all the processes running on all the servers is too much for me already. That is why I only want automated solution that I set up once and forget about that.

    I got several servers with hrefer and I need to automate this task as I got 4 paid subscriptions APIs, but usually they export 4 - 10k proxies daily. I need 1 software that downloads all the APIs, checks proxies for google which hrefer cannot do and exports to FTP so hrefers can download links that are already checked for google (they check only for annonimity).

    I did that with proxy goblin for a while, but it turned to we all know what.

    I also wanted to subscribe to your service, but as u wrote - not enough posts.. :D
     
  9. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,202
    Likes Received:
    8,689
    well at least it can never be said im all about the money.
    and my service isnt automated , its done over skype
    via skype group
     
  10. goooral

    goooral Newbie

    Joined:
    Jan 27, 2012
    Messages:
    42
    Likes Received:
    31
    Occupation:
    SEO expert
    Home Page:
    all that only says its a good service, and it makes me want it more now.. :)

    Also - I start to believe that there is no good software to automate what I want to have done.
     
  11. goooral

    goooral Newbie

    Joined:
    Jan 27, 2012
    Messages:
    42
    Likes Received:
    31
    Occupation:
    SEO expert
    Home Page:
    aleenajoe - nice to meet u - u sound just like xRumer spam bot... :p interesting...

    EDIT: there was a post above this one.. :D
     
    Last edited: Mar 15, 2013
  12. kvmcable

    kvmcable Supreme Member

    Joined:
    Dec 28, 2010
    Messages:
    1,355
    Likes Received:
    2,815
    Occupation:
    24 year business owner - old school dude
    Location:
    KFC - BW3
    What you want is ZennoProxyChecker (not the one built into zp, the separate one) if you want to feed it a list, have it scrape the proxies from that list at intervals and then check and filter those proxies. All automated and works like a frickin beast. I have it set up at 1500 threads and it checks 10k proxies a minute, 24/7. It never stops. Keep feeding it good lists and see your good proxies increase. I had to throttle back a bit as I was chewing up 15GB of BW a day doing constant rechecks to filter dead proxies.

    I automated it with dropbox from the VPS and now I can open files from my desktop with Google passed, http anon, socks or whatever lists I need in a second knowing those proxies were live within the last hour. I even have lists by geo all nice and tidy. Want working proxies from USA, as simple as opening a file now.

    Not talked about much around here but best solution I came up with. Of course you need good lists but I have another tool that finds and fetches those urls 24/7. Drops me a list of the best urls on a steady basis.
     
    Last edited: Mar 14, 2013
  13. goooral

    goooral Newbie

    Joined:
    Jan 27, 2012
    Messages:
    42
    Likes Received:
    31
    Occupation:
    SEO expert
    Home Page:
    Just checked the website - 47$ doesnt seem to bad. Im gonna download a demo and check it out.

    About the speed - that would be great tool if it works as u said. I got a problem with PG, it cannot use too many threads. And my CPU/RAM doesnt really matter.

    For example - I got 64 gb RAM, CPU 1230v2 and it crashes after 300 threads (when only PG is running).

    If ZennoProxySomething is gonna solve this problem, then Im gonna be super happy.

    Thanks for your advice. Im checking it today and will let know how it worked.

    EDIT: Also - feel free to drop me a line by PM with the other tool u r using to scrape it :) I promise, I wont tell anybody :)
     
  14. goooral

    goooral Newbie

    Joined:
    Jan 27, 2012
    Messages:
    42
    Likes Received:
    31
    Occupation:
    SEO expert
    Home Page:
    kvmcable - just running it on 4000 threads check :) Its kinda awesome !

     
    • Thanks Thanks x 1
  15. kvmcable

    kvmcable Supreme Member

    Joined:
    Dec 28, 2010
    Messages:
    1,355
    Likes Received:
    2,815
    Occupation:
    24 year business owner - old school dude
    Location:
    KFC - BW3
    Yeah, I throttled back because it was overkill. I was chewing up bandwidth for nothing rechecking the same proxies every 15 mins to find the results 95% the same. My other tools only fetch the list 4 times a day so no need to hammer the list every 15 mins.

    I say it's a beast after running PM. PM will harvest a million proxies but take days to check them. With public proxies you need tools that can do this in minutes and not days. If any proxies were live, by the time PM gets around to checking them they'll be dead.

    As far as link tool it's the same PM with the addon that captures the urls and saves them to the database. Get PM with both addons so you work all 3 search engines and let it build your url list. Prune and export the list and then import to zennoproxychecker ;-)
     
  16. goooral

    goooral Newbie

    Joined:
    Jan 27, 2012
    Messages:
    42
    Likes Received:
    31
    Occupation:
    SEO expert
    Home Page:
    u kinda lost me on the "getting urls with PM" I never used Proxy Multiply, can u tell me how can I harvest urls with PM? I would probably figure it out but I guess its super easy, u just need to know where to find it.

    Also - thanks for your help kvmcable - I've never been so much of a "forum asking" fan, but now I see it can be helpful ;)
     
    • Thanks Thanks x 1
  17. kvmcable

    kvmcable Supreme Member

    Joined:
    Dec 28, 2010
    Messages:
    1,355
    Likes Received:
    2,815
    Occupation:
    24 year business owner - old school dude
    Location:
    KFC - BW3
    PM has two available addons to the base software

    http://proxy.jrimsoftware.com/addon-search-booster

    http://proxy.jrimsoftware.com/addon-proxy-booster

    One addon allows PM to search Yahoo and Bing as well as Google. The other addon stores the successful URLs in the database.

    So if you follow the BHW link you get PM and both addons for just under $50. Toss it on two machines and just let it run. In a few days you'll see a list of successful urls that PM found on the 3 search engines and stored in the database. Prune the dead ones, export the gold and drop in zennoproxychecker.
     
  18. goooral

    goooral Newbie

    Joined:
    Jan 27, 2012
    Messages:
    42
    Likes Received:
    31
    Occupation:
    SEO expert
    Home Page:
    Ok, im gonna test that PM thing as soon as Im gonna get to the server in my office, where PM is installed.

    Got a question about zenno proxy checker - I got like 100 google proxies, but 80% of those are dead when testing in scrapebox... Is it like that when u scrape proxies with this tool?
     
  19. kvmcable

    kvmcable Supreme Member

    Joined:
    Dec 28, 2010
    Messages:
    1,355
    Likes Received:
    2,815
    Occupation:
    24 year business owner - old school dude
    Location:
    KFC - BW3
    SB proxy judge isn't reliable so don't trust it 100%. At bare minimum test them twice. When using SB make sure to reduce your connections and increase your timeouts for GP proxies. Remember you're working with public proxies so most likely they're in use when you go to test them. Also don't ignore the GP proxies with captcha as many of those will turn into non-captcha after a soft ban period.

    Finding GP proxies in the public is purely a numbers game. You need to harvest a lot of proxies, keep testing for dead ones and maintaining your lists. At any give time my GP list is just over 1000 and GP with captcha just over 3000. When I'm ready to use SB, I toss in the 3000 list, set connections to 50 and timeouts to 30 and typically have about 400 pass when I'm ready to do some SB work. More than enough for my tasks.

    Good luck
     
  20. goooral

    goooral Newbie

    Joined:
    Jan 27, 2012
    Messages:
    42
    Likes Received:
    31
    Occupation:
    SEO expert
    Home Page:
    Ty, KVMCABLE, will set it up like that.

    Would u mind sharing your setup for sources.

    I use proxy
    type - AUTO,
    test - ALIVE, POST, SPEED,
    request - 00.00.20
    dup. 00.00.05
    recheck 15 minutes
    and google check - I just check it with default settings.

    What do u think about that?

    Also - I redownload every hour and remove old is unchecked
     
    Last edited: Mar 16, 2013