SEO Lab: PHP Source for proxying Google searches

khaoss said:

hello,

I'm really interested about your graphs..

I would like to know how can i produce similar graphs like you with my site for analyze bytes e mached data ..

You said that you use php script for funnelling google searchs round robin data.. where can i get it ?

Or .. can you tell me, please , which hosting do it ?

Thank you.

Click to expand...

I use 6 of the cheapest webhosting providers on a month by month plan because when the captcha comes up I just start a new month 2 month elsewhere and cancel the blocked one. I send a request to each node in parallel then wait 3 seconds... 6 reqs/3 sec = 1 req every .5 sec which is plenty fast if you don't mind collecting data over a span of a week... which I don't... The grid runs for a few days a month and the rest of my time goes into analyzing the data.

I don't want to punish my hosts... if it is in the $3-$8 per month range, supports php, comes with a free domain, and is cancel anytime, and I don't already have an account there then I don't think twice... don't double up on a hosting provider. Usually google captchas the whole server group... If you keep your requests low like I do you wont ever trigger the captcha.

I don't all my work in Java, but PHP is necessary for the proxy grid to keep costs low. All my other source is in Java.


Cheers

I'm totally downloading all this stuff you've been posting in hopes of understanding enough one day to use this as a basis for my own lab.

Thanks for sharing, mate.

PS. after looking at the stuff i just downloaded and re-reading your description, this doesn't sound all too difficult to pull off. However, if you're feeling generous you could save me some time and explain how you setup these files on your host, and with what/how you send requests for these web applications to go to work.

chockomonkey said:

I'm totally downloading all this stuff you've been posting in hopes of understanding enough one day to use this as a basis for my own lab.

Thanks for sharing, mate.

PS. after looking at the stuff i just downloaded and re-reading your description, this doesn't sound all too difficult to pull off. However, if you're feeling generous you could save me some time and explain how you setup these files on your host, and with what/how you send requests for these web applications to go to work.

Click to expand...

Sure... I upload them "AS IS" to the hosting provider then just

start requesting hxxp://myfreehostingdomain.com/?q=URL

where URL is an encoded URL to retrieve via the proxy...

hxxp://www.google.com/search?num=100&q=SEO

is a url I want so I UTF-8 encode it

hxxp://myfreehostingdomain.com/?q=hxxp://www.google.com/search%3fnum=100%27q=SEO

ipopbb said:

Sure... I upload them "AS IS" to the hosting provider then just

start requesting hxxp://myfreehostingdomain.com/?q=URL

where URL is an encoded URL to retrieve via the proxy...

hxxp://www.google.com/search?num=100&q=SEO

is a url I want so I UTF-8 encode it

hxxp://myfreehostingdomain.com/?q=hxxp://www.google.com/search%3fnum=100%27q=SEO

Click to expand...

Thanks a lot for this!! I don't have time right now to implement anything, but when i do I guarantee you just saved me hours of time googling