1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

ProxyMultiply Users: Do you guys regularly update your 'proxy fetching urls'?

Discussion in 'Proxies' started by SilverKnight, Jul 4, 2012.

  1. SilverKnight

    SilverKnight Power Member

    Joined:
    May 31, 2011
    Messages:
    595
    Likes Received:
    51
    If yes, where do you find the URLs to add there?

    Everyday, the list of working proxies gets smaller and smaller. Yesterday, I searched 20,000 proxies and after the test only 4 were working and their speed was 15000ms+. Right now, I again searched 30,000 proxies and after the test, only one is working and its speed is 18565ms.

    What to do?
     
  2. hassan_isabad_subar

    hassan_isabad_subar Jr. VIP Jr. VIP

    Joined:
    May 23, 2012
    Messages:
    260
    Likes Received:
    70
    Occupation:
    BHProxies Staff
    Home Page:
    Its nice to know I'm not the only one. I've been using it non-stop for non-seo purposes, instead I'm running proxies in a voting application. Anyway, each day its been getting slower. Started off at getting anywhere between 3,000-1,500, then it started pulling only in the 100's. As of booting it up this morning, I'm grabbing 2 proxies. Keep in mind, I have it set to 'catch all' pretty much. Anything that's working, I'll roll with. I need raw numbers for my purposes.
    Anyway, I'm wondering you're getting the same error as me,
    This is kind of random, and showed up for the 1st time today. Maybe that's why I'm at a crawl now.
     
  3. SilverKnight

    SilverKnight Power Member

    Joined:
    May 31, 2011
    Messages:
    595
    Likes Received:
    51
    I don't remember getting that error.

    One reason I could think of why we are getting less and less working proxies is because the fetching URLs that are already in our PM are getting old, thus, the proxies on those URLs getting old as well and that's why they are dying. I think we need to keep that list updated. But where to find the latest proxy URLs?
     
  4. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,275
    Likes Received:
    8,710
    thats why scrapebox for 57$ was always the better tool
    even though scrapebox is mainly for back linking
    the built in keyword scraper allows you to search for
    any links over the last 24 hrs it takes maybe 2/3 mins to get
    the urls . then leech them. use 20 tested proxies to scrape with

    ProxyMultiply is similar in nature to forum proxy leecher
    they both work on the principle of leeching proxys from links
    but if the links arnt updated by the tool maker or owner the
    effectiveness will drop. i dont harvest proxys anymore but 3
    yrs ago this is how i use to

    foot print - anonymous proxies - keywords = proxy port number list
    [​IMG]

    take harvested urls and scrape them, i always used my own custom url scraper .
    [​IMG]

    then save the scraped proxies and test them. if u want a fast test, use bleech
    with a custom proxy judge, for a slower more accurate test use charon, for this
    example im gonna use bleech and test the proxies found.

    [​IMG]


    and this is the list of urls scraped today, now yes some dont work i didnt
    have time to remove the none working ones, but feel free to try them
    LINKS
     
    Last edited: Jul 4, 2012
  5. williamk

    williamk BANNED BANNED

    Joined:
    Oct 29, 2009
    Messages:
    1,030
    Likes Received:
    184
    Yeah, I alwasys scrape new urls from Scrapebox and add them to the list. Helps a lot I can tell you.
     
  6. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,275
    Likes Received:
    8,710
    i moved away from scraping proxies from urls. to over used
    over saturated. die fast because url scraped proxies is something
    everyone can scrape. i went over to port scanning public proxies
    3 yrs ago. that's looking for public proxies that cant be url harvested
    because fewer people have them, last longer. thats why
    getting 2/3k per day google passed proxies can support my service
    of 600+ users who use them to url scrape with scrapebox everyday
     
  7. portalweb

    portalweb Supreme Member Premium Member

    Joined:
    Jan 7, 2010
    Messages:
    1,415
    Likes Received:
    547
    Occupation:
    Hard Core Engineer
    Location:
    New York
    That is why it's best to subscribe to proxy services who can do much better job at providing the working proxies - that will save you many hours.
     
  8. eline

    eline Newbie

    Joined:
    Feb 1, 2010
    Messages:
    46
    Likes Received:
    12
    Home Page:
    Thanks proxygo for nice tool (bleech). Im still leching proxies but with my own php bulid harvester.
     
  9. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,275
    Likes Received:
    8,710
    bleech is just a fast way to test for a proxies working live
    status but it does the job
     
  10. badabaccha

    badabaccha Newbie

    Joined:
    Jul 21, 2012
    Messages:
    14
    Likes Received:
    1
    Home Page:
    according to me scrapebox is the most helpful in SEO
     
  11. bilbo

    bilbo Power Member

    Joined:
    Jan 26, 2009
    Messages:
    644
    Likes Received:
    1,134
    Occupation:
    an actor on wizard of oz - the 3rd munchkin
    Location:
    middle earth
    WTF??? have you been drinking
     
  12. Kazi_Haque

    Kazi_Haque Regular Member

    Joined:
    Aug 13, 2010
    Messages:
    325
    Likes Received:
    425
    Occupation:
    Internet Marketing
    Location:
    Melbourne, Australia
    Haha...may be he is. He said according to him.
     
  13. ranga

    ranga Regular Member

    Joined:
    Aug 9, 2009
    Messages:
    268
    Likes Received:
    85
    I use proxy multiply addon which is must have if you want fast proxies. I easily get 2-3k working anon (non-google) easily on my vps
     
  14. eline

    eline Newbie

    Joined:
    Feb 1, 2010
    Messages:
    46
    Likes Received:
    12
    Home Page:
    @ranga - can you share what settings you are using in PM and what configuration of VPS you have?
     
  15. kilaz

    kilaz Jr. VIP Jr. VIP

    Joined:
    Aug 15, 2009
    Messages:
    876
    Likes Received:
    382
    Home Page:
    Scrabebox is a great tool, I use it all the time but I never liked using the built in proxy source list because so many other programs use them and the proxies are usually beat to hell. Your better off subbing to a proxy list where the provider scans for their own proxies. You have a better chance of finding longer lasting and better working public proxies that way. Let them do all the work for you and spend your time making money instead of looking for proxies :)
     
  16. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,275
    Likes Received:
    8,710
    not everyone can afford a sub killaz so for some people
    scraping proxies is all they can do
     
  17. eline

    eline Newbie

    Joined:
    Feb 1, 2010
    Messages:
    46
    Likes Received:
    12
    Home Page:
    I would like to buy proxy from a trust vendor than scan them myself, but mostly they do this same as me, and sell those list to thousands users for $5 month. So proxies goes down quick, and many of proxy provfiders dont have API or autoupdate, so you have login, copy and paste new proxies to ride off those killed once. Its not faster and better and you have to spend this same amount of time ;)

    Next important information is: most on new software has proxy grabbers bulid in. So they do all at once. Its not great solution when you have few programs and each grab own proxies, but this is something what will also kill public proxies, as they all use this same sources ;) So when I use GSA and few instances of ScrapeJet I grab and test proxys with bulid in this programs leechers.
     
  18. triplefault

    triplefault Newbie

    Joined:
    Nov 1, 2011
    Messages:
    9
    Likes Received:
    1
    Location:
    DK
    If you don't mind sharing - which hosting provider do you use for your scans?
     
  19. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,275
    Likes Received:
    8,710
    i use my own isp - that's all ille say
     
    • Thanks Thanks x 1