I am wanting to know a little bit more detail in regards to the best types of proxies I should be using for scraping SE's (with Hrefer, so not only google)
For harvesting, I realize that public proxies are the way to go when dealing with mass. That is pretty common knowledge. But I want to know more.
What else should I be paying most attention to, and what should I not care about?
- Some say 'Anonymous' is not super important (confusing).
- Some say both HTTP & SOCKS work, SOCKS are faster, but harder to find.
- Some say to stay away from China/Pakistan proxies (as they wont harvest)
I realize that I can just do some tests and probably figure this stuff out on my own, and I am, but it would be super appreciated if somebody very knowledgeable about proxies could chime in and help me shortcut my testing
For harvesting, I realize that public proxies are the way to go when dealing with mass. That is pretty common knowledge. But I want to know more.
What else should I be paying most attention to, and what should I not care about?
- Some say 'Anonymous' is not super important (confusing).
- Some say both HTTP & SOCKS work, SOCKS are faster, but harder to find.
- Some say to stay away from China/Pakistan proxies (as they wont harvest)
I realize that I can just do some tests and probably figure this stuff out on my own, and I am, but it would be super appreciated if somebody very knowledgeable about proxies could chime in and help me shortcut my testing