1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

50 private proxies for scraping

Discussion in 'Proxies' started by nakmuay7, Dec 11, 2011.

  1. nakmuay7

    nakmuay7 Junior Member

    Joined:
    Mar 23, 2011
    Messages:
    105
    Likes Received:
    19
    im after about 50 private proxies for scraping thousands of keyterms.

    they will only be needed for one run, probably lasting a week from a vps server.

    whats the cheapest way to do this? i am paying currently $5 for 4 proxies from elite proxies but this is way too expensive for what i need and they will be mostly blacklisted by end of week i will imagin.

    can anyone offer a solution? purhaps do the scraping for me if you already have scrapebox with 50 or 100 proxies?

    any suggestion welcome.
     
  2. mindmaster

    mindmaster Jr. VIP Jr. VIP Premium Member

    Joined:
    Sep 16, 2010
    Messages:
    2,501
    Likes Received:
    1,136
    Location:
    at my new office
    Why don't you use free proxies?

    If you tweek your settings you will scrape hundreds of urls / second with shared proxies. At least I do.
     
  3. nakmuay7

    nakmuay7 Junior Member

    Joined:
    Mar 23, 2011
    Messages:
    105
    Likes Received:
    19
    i have never been able to find public proxies that work EVER. i can harvest a thousand and not be able to do anything with them.

    i was hoping there would eb a way for me to create my own sets of proxy ip addresses on my vps ive always managed with about 5 proxies a month untill now i need to do a big scraping run.
     
  4. cooltoad

    cooltoad Senior Member

    Joined:
    Sep 10, 2010
    Messages:
    934
    Likes Received:
    549
    Occupation:
    None of your business
    Location:
    On Vacation
    Google doesn't issue a perm ban on the proxies. By the time you are finished with the 50th, most of the proxies will be out of google ban.
     
    • Thanks Thanks x 1
  5. mindmaster

    mindmaster Jr. VIP Jr. VIP Premium Member

    Joined:
    Sep 16, 2010
    Messages:
    2,501
    Likes Received:
    1,136
    Location:
    at my new office
    I am getting 500 - 700 proxies from 4k proxies scraped with scrapebox. I noticed that I can scrape more than 24 hours with 200-800 urls/sec, with 500 public proxies.
    Find other sources than the ones provided by default in scrapebox.
     
  6. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,297
    Likes Received:
    8,717
    private proxies to scrape is a waste of money
    they will suffer 3hrs temp bans on large scrapes
    this is why everyone uses public proxies to scrape
    and private ones to post.
    the average user with little help can find 3/500 working
    scraping public proxies most days.
    people with more no how can find 1500 like i do
    save your money 50 private is total over kill and a
    waste of your money.

    my advice is find your own public proxies to do it
    or pay some1 to do it for you, plenty of people here
    supply scraping proxies for scrapebox
     
    • Thanks Thanks x 1
  7. dangervol

    dangervol Registered Member

    Joined:
    Aug 10, 2009
    Messages:
    73
    Likes Received:
    38
    If you are scraping or harvesting you need a big list of public proxies. For this I use what is the best deal I have ever found for $25 (for lifetime) you get a new proxy list sent to you everyday and the Planetlab CoDeeN proxies are separated. Here is the url for proxies I just mentioned http://hidemyass.com/proxy-list/premium/.

    I usually just use the US proxies but there are enough to keep you going.

    Also, it is not a good idea to use private proxies for scraping or harvesting.

    If you use scrapebox check Looplines video on getting your own public proxy list. It is basically what the guys do that sell public proxies. Here is the video youtube.com/user/looplinescrapebox it is the video about how to obtain your own proxy sources.

    DV
     
  8. kokoloko75

    kokoloko75 Elite Member

    Joined:
    Jan 1, 2011
    Messages:
    1,628
    Likes Received:
    1,936
    Occupation:
    Design director
    Location:
    Paris (France)
    Agree with Proxygo, do not waste private proxies on scraping tasks.
    Public proxies will do this step without problems.
    Use private proxies to post, there is less risk that these addresses are already flagged.

    Personally I use only public proxies (scraping and posting).
    And if your proxy provider is good, you will not need private proxies.
    In my opinion...

    Beny
     
  9. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,297
    Likes Received:
    8,717
    if u just harvested 10k public proxies and only
    got 10 working heres why u failed
    1 - your settings are bad
    2 - your proxie sources as bad
    and its probably number 2.

    i picked up just over 1k google passed today
    so proxies are fine

    [​IMG]
     
  10. jamesvick

    jamesvick Senior Member

    Joined:
    Jul 26, 2010
    Messages:
    968
    Likes Received:
    653
    Location:
    article directories
    Home Page:
    you guys are using wrong tool. hrefer proxy engine is the best. it gets me 500-600 working proxies under 30 mins. their proxy checking script is good. sources can be used anywhere but actual checking is faulty here. i wish SB could adopt their script.
     
  11. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,297
    Likes Received:
    8,717
    ahh thank you for that from a 9 poster wizz kid from 2010
    who's only contribution is nothing.
    30 mins testing to get 500 is slowwwwwww boy
    i can test 4k in 15 mins and get 1k+ in scrapebox
    comments ignored:nana:
     
  12. dumdum4gumgum

    dumdum4gumgum Power Member

    Joined:
    Oct 16, 2008
    Messages:
    590
    Likes Received:
    343
    Occupation:
    cet, networking,grool,c++
    Location:
    In my world
    Home Page:
    Id have to say Proxy multiplier Is a great proxy tool for free proxies.
    But yes everything proxygo has said.
     
    • Thanks Thanks x 1
  13. Designerdude13

    Designerdude13 Power Member

    Joined:
    Nov 22, 2010
    Messages:
    646
    Likes Received:
    190
    Gender:
    Male
    What software do you use? I usually only get 3 working when I run proxy multiplier out of 14,000 proxies
     
  14. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,297
    Likes Received:
    8,717
    i port scan proxies
    something no1 else does on bhw