1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Best Proxy Service for HRefer Google/Bing Scraping?

Discussion in 'Black Hat SEO Tools' started by MicrosoftPoints, Nov 1, 2016.

Tags:
  1. MicrosoftPoints

    MicrosoftPoints Regular Member

    Joined:
    Aug 8, 2009
    Messages:
    327
    Likes Received:
    192
    Occupation:
    IM!
    Location:
    USA
    Hello everyone,

    I am looking for a good proxy service for scraping URLs from Google/Bing using Hrefer (preferably $30 a month or less for 50 + connections/threads)

    I am trying https://www.proxyrack.com/ but the success rates for scraping are quite low.

    Thanks
     
  2. topcoder

    topcoder Regular Member

    Joined:
    Jan 31, 2012
    Messages:
    205
    Likes Received:
    29
    How much scrapping are you doing? I just use the API's supplied by google and bing.
     
  3. MicrosoftPoints

    MicrosoftPoints Regular Member

    Joined:
    Aug 8, 2009
    Messages:
    327
    Likes Received:
    192
    Occupation:
    IM!
    Location:
    USA
    The occasional scraping. Right now I have a list of 20k keywords and 5 footprints, so I need to do 100k queries. The goal is to get this done yesterday (ASAP). Let's say in 48 hours--that means I can do like 2 queries every 3 minutes.
     
  4. topcoder

    topcoder Regular Member

    Joined:
    Jan 31, 2012
    Messages:
    205
    Likes Received:
    29
  5. MicrosoftPoints

    MicrosoftPoints Regular Member

    Joined:
    Aug 8, 2009
    Messages:
    327
    Likes Received:
    192
    Occupation:
    IM!
    Location:
    USA
    Yeah that's way too expensive. I can get 100 private proxies for $75 and can easily perform 1 query every 3 minutes without getting banned. This will take 66 hours.

    What I'm looking for is something like a 5k list of public proxies that are refreshed 2-3 times a day. This way I can just churn and burn my way through the list and just do 2-3 passes to ensure I minimize the amount of lost data from banned IPs.
     
  6. proxygo

    proxygo Jr. VIP Jr. VIP

    Joined:
    Nov 2, 2008
    Messages:
    20,081
    Likes Received:
    10,408
    Gender:
    Male
    Occupation:
    PROXIES .
    Location:
    UK - ALWAYS ON BHW
    Home Page:
    i do that here if it helps
    https://www.blackhatworld.com/seo/gsa-proxies-1-2k-per-day-life-time-subscription.831919/

    im the main goto guy for that on bhw 7 day service 1 list a day 2-3k proxies
    use as long as u want 140GBP/172$
    but with me u pay once use as long as u want.

    2 list a day service 4-6k proxies a day would cost with me 370$ but all
    subscribers as that product is new are getting it for 247$ aka 200GBP
    u will get 4-6 proxies all year round cept my hollidays.

    sure people pay in advance, but some of my products have run 3-6 years,
    think of all those 30$ a month u will save.
     
    Last edited: Nov 3, 2016
  7. MicrosoftPoints

    MicrosoftPoints Regular Member

    Joined:
    Aug 8, 2009
    Messages:
    327
    Likes Received:
    192
    Occupation:
    IM!
    Location:
    USA
    Yeah that's not bad but I only scrape 2-3 times a year. I'd need to count on this service for 3-4 years before I get my money's worth.
     
  8. proxygo

    proxygo Jr. VIP Jr. VIP

    Joined:
    Nov 2, 2008
    Messages:
    20,081
    Likes Received:
    10,408
    Gender:
    Male
    Occupation:
    PROXIES .
    Location:
    UK - ALWAYS ON BHW
    Home Page:
    I am looking for a good proxy service for scraping URLs from Google/Bing using Hrefer (preferably $30 a month

    if u signed up just to my mon fri service 110GBP - 140$ so have lists sent everyday mon/fri weather u
    use them or not............theres your 3-4 times a year 1 year, this is a perma sub.

    remember this if u end up scraping 6 times in a year gonna set u
    back 180 on 30$ monthly sub as apposed to 1 fee 140$ and its there
    all year round this year/next/ but hay there u go

    ide still save u ton money in the long run
     
  9. arsen99

    arsen99 Jr. VIP Jr. VIP

    Joined:
    Nov 28, 2010
    Messages:
    311
    Likes Received:
    47
    Home Page: