Does using a proxy reduce CPU load?

topcoder

Regular Member
Joined
Jan 31, 2012
Messages
209
Reaction score
36
I haven't tested it yet, just curious..

If I scrap with MY IP - My CPU can go through the roof depending on the number of threads I launch, is this reduced somewhat with a proxy service? Does the initial load go on their servers?

Or is it going to be equal or worse.

I'm starting to get to the point where I'll be ready to buy a proxy service.

Just coded the search portion using bing CSE Api (5000 queries a month) and Google CSE (100 a day).
So I won't have to worry about getting proxies that don't work with google or bing.
 
From your saying i understand that:
You got a program and in that you can have an API integrated which will provide you Google SERP data ?

And your CPU spikes when you increase threads and you think to get proxies for that purpose OR not right?

Or something else if yes explain it.
 
Yes, you nailed it.

I also did some testings and the CPU load shrinks with a proxy service.
 
Yes, you nailed it.

I also did some testings and the CPU load shrinks with a proxy service.
ok great.

Basically then proxies is nothing to do with your CPU.It's related with your Network connection instead mostly.

And for CPU spikes it's depends on your number of threads,Task of your program doing and how well is your software is optimized for CPU usage.

Hope it helps
 
Back
Top