topcoder
Regular Member
- Jan 31, 2012
- 209
- 36
I haven't tested it yet, just curious..
If I scrap with MY IP - My CPU can go through the roof depending on the number of threads I launch, is this reduced somewhat with a proxy service? Does the initial load go on their servers?
Or is it going to be equal or worse.
I'm starting to get to the point where I'll be ready to buy a proxy service.
Just coded the search portion using bing CSE Api (5000 queries a month) and Google CSE (100 a day).
So I won't have to worry about getting proxies that don't work with google or bing.
If I scrap with MY IP - My CPU can go through the roof depending on the number of threads I launch, is this reduced somewhat with a proxy service? Does the initial load go on their servers?
Or is it going to be equal or worse.
I'm starting to get to the point where I'll be ready to buy a proxy service.
Just coded the search portion using bing CSE Api (5000 queries a month) and Google CSE (100 a day).
So I won't have to worry about getting proxies that don't work with google or bing.