1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

SEO Lab: PHP Source for proxying Google searches

Discussion in 'White Hat SEO' started by ipopbb, May 20, 2010.

  1. ipopbb

    ipopbb Power Member

    Joined:
    Feb 24, 2008
    Messages:
    626
    Likes Received:
    844
    Occupation:
    SEO & Innovative Programming
    Location:
    Seattle
    Home Page:

    I use 6 of the cheapest webhosting providers on a month by month plan because when the captcha comes up I just start a new month 2 month elsewhere and cancel the blocked one. I send a request to each node in parallel then wait 3 seconds... 6 reqs/3 sec = 1 req every .5 sec which is plenty fast if you don't mind collecting data over a span of a week... which I don't... The grid runs for a few days a month and the rest of my time goes into analyzing the data.

    I don't want to punish my hosts... if it is in the $3-$8 per month range, supports php, comes with a free domain, and is cancel anytime, and I don't already have an account there then I don't think twice... don't double up on a hosting provider. Usually google captchas the whole server group... If you keep your requests low like I do you wont ever trigger the captcha.

    I don't all my work in Java, but PHP is necessary for the proxy grid to keep costs low. All my other source is in Java.


    Cheers
     

    Attached Files:

    • Thanks Thanks x 3
  2. chockomonkey

    chockomonkey Regular Member

    Joined:
    Mar 27, 2009
    Messages:
    366
    Likes Received:
    40
    Location:
    the States
    I'm totally downloading all this stuff you've been posting in hopes of understanding enough one day to use this as a basis for my own lab.

    Thanks for sharing, mate.

    PS. after looking at the stuff i just downloaded and re-reading your description, this doesn't sound all too difficult to pull off. However, if you're feeling generous you could save me some time and explain how you setup these files on your host, and with what/how you send requests for these web applications to go to work.

    :)
     
    Last edited: May 20, 2010
  3. ipopbb

    ipopbb Power Member

    Joined:
    Feb 24, 2008
    Messages:
    626
    Likes Received:
    844
    Occupation:
    SEO & Innovative Programming
    Location:
    Seattle
    Home Page:

    Sure... I upload them "AS IS" to the hosting provider then just

    start requesting hxxp://myfreehostingdomain.com/?q=URL

    where URL is an encoded URL to retrieve via the proxy...

    hxxp://www.google.com/search?num=100&q=SEO

    is a url I want so I UTF-8 encode it

    hxxp://myfreehostingdomain.com/?q=hxxp://www.google.com/search%3fnum=100%27q=SEO
     
    • Thanks Thanks x 1
  4. chockomonkey

    chockomonkey Regular Member

    Joined:
    Mar 27, 2009
    Messages:
    366
    Likes Received:
    40
    Location:
    the States
    Thanks a lot for this!! I don't have time right now to implement anything, but when i do I guarantee you just saved me hours of time googling :)