Hrefer - Proxy/VPN solution?

[Ambassy]

Basically I've come to realize that I can't live with public proxies. What are the options for hrefer?
I mean how many private proxies would I need to run hrefer 6 hours a day?

I've heard about using VPN and changing proxies every 10 minutes. Would that work? If so, what VPN should I use?

 

[marrrko]

I using each day more than 100 proxies, and i want to rise that number, because xrefer is a beast

 

[Ambassy]

I using each day more than 100 proxies, and i want to rise that number, because xrefer is a beast

Are you using private, shared or public proxies?

 

[2makemoney]

I sent you a pm. Free VPN

VPNOD is giving away free vpn and it located in USA 30mbp connection so it is extreamly fast for a free service.

 

[marrrko]

Are you using private, shared or public proxies?

All of them are private, because if you using shared especially public proxies your success rate will be pretty lower.
In my case it was lower for 40%

 

[Ambassy]

I sent you a pm. Free VPN

VPNOD is giving away free vpn and it located in USA 30mbp connection so it is extreamly fast for a free service.

It might be a rookie question but can I change ip's when I'm on a VPN by using a tool like angry IP scanner?

All of them are private, because if you using shared especially public proxies your success rate will be pretty lower.
In my case it was lower for 40%

Where do you buy your proxies? And how long can you harvest without getting banned? (and at what speed)

Thanks for your answers btw.

 

[2makemoney]

It might be a rookie question but can I change ip's when I'm on a VPN by using a tool like angry IP scanner?



Where do you buy your proxies? And how long can you harvest without getting banned? (and at what speed)

Thanks for your answers btw.

That would make it even slower. that Like using a proxy to connect to another proxy. It increase unnecessary connections.

 

[Ambassy]

That would make it even slower. that Like using a proxy to connect to another proxy. It increase unnecessary connections.

Okay but how would a VPN help me when using hrefer then? I mean isn't it just 1 ip? I'd assume it would get banned within minutes.

 

[flintR]

why dont you buy shared ip list ?
its cost you less, good for hrefer i think,

VPN is usually give you 1-10max IP

 

[Ambassy]

why dont you buy shared ip list ?
its cost you less, good for hrefer i think,

VPN is usually give you 1-10max IP

But how many proxies will I need to succesfully harvest urls a few hours every day?

 

[rickstar]

Here's a good article about VPN providers. I would typically either recommend HMA, StrongVPN or iVPN.

http://torrentfreak.com/which-vpn-providers-really-take-anonymity-seriously-111007/

 

[Ambassy]

Here's a good article about VPN providers. I would typically either recommend HMA, StrongVPN or iVPN.

**URL**

Thanks I read it through. However I still don't understand why a VPN is needed? I mean isn't a VPN just like 1 proxy? Won't it get banned by google within minutes?

 

[jb2008]

Hardcore hrefer harvesting won't work with a VPN. I harvest using 1000 threads maxed out. Does about 40 mbps. I use a list of about 2000 G passed public proxies.

You are gonna have to live with public proxies, because getting private proxies in such volumes is extremely expensive.

 

[Ambassy]

Hardcore hrefer harvesting won't work with a VPN. I harvest using 1000 threads maxed out. Does about 40 mbps. I use a list of about 2000 G passed public proxies.

You are gonna have to live with public proxies, because getting private proxies in such volumes is extremely expensive.

Thanks for your answer.
Would you mind roughly telling me where you're getting your proxies from? When I proxy cvheck from sites such as scrapeboxproxies . net I only get around 100-150 working proxies per day.

 

[kinox]

Hardcore hrefer harvesting won't work with a VPN. I harvest using 1000 threads maxed out. Does about 40 mbps. I use a list of about 2000 G passed public proxies.

You are gonna have to live with public proxies, because getting private proxies in such volumes is extremely expensive.

2000? Leave some proxies for the rest of us! Seriously though, that is pretty hardcore after all...

 

[kokoloko75]

With Hrefer I use only public proxies, around 500-1000 Google Passed (IP Test).
Results are excellent, Hrefer is so fast.

Here some tips to get good proxies :

Use proxies daily provided in Proxy section of BHW :

http://www.blackhatworld.com/blackhat-seo/f103-proxy-lists/

Explore ProxyFire forum to get a bit more :

http://www.proxyfire.net/

To find sources for scraping proxies, try this footprint on Google :

inurl:"/proxyc/engine.php"

Then, choose one result and change in URL "engine.php" by "list.txt".

These are the simplest ways.
Good luck !

Beny