- Mar 13, 2010
- 2,271
- 515
If I want to scrape using yahoo or google is a necessity to use fake header/user agents? or are good private proxies on their own enough?
Are fake headers a necessity?
- Thread starter HaxTuTorial
- Start date
- May 10, 2011
- 6,104
- 534
Private proxies are enough. mostly i use some good free proxies only, there is a good proxy section here. Look around.
Repulsor
Senior Member
- Jun 11, 2013
- 904
- 357
I would obviously use different useagents and headers.
Random useragents is just one line of code in curl, using this nice library.
danmorgan n~e~t/programming/php-programming/random-useragent-in-curl-and-php
Why would you want your script to stop working out of blue?
Random useragents is just one line of code in curl, using this nice library.
danmorgan n~e~t/programming/php-programming/random-useragent-in-curl-and-php
Why would you want your script to stop working out of blue?