1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to scrap google results ?

Discussion in 'Black Hat SEO' started by seo101, Mar 16, 2008.

  1. seo101

    seo101 Registered Member

    Joined:
    May 2, 2007
    Messages:
    94
    Likes Received:
    15
    Hi,
    My program scraps google daily. And between each scrap I put a random time delay to make it look natural. I also use different proxies. But still google notice it and redirect the result to sorry.google.com . My program works fine when scraping MSN and yahoo results. Any suggestion ?

    Thanks
     
  2. drakoh

    drakoh Newbie

    Joined:
    Feb 16, 2008
    Messages:
    5
    Likes Received:
    2
    google uses cookies, so be sure to handle them
     
  3. blackknyt

    blackknyt Newbie

    Joined:
    Mar 9, 2008
    Messages:
    12
    Likes Received:
    0
    also look into using your own proxy server or paid proxies I think the public ones get abused a lot and get their ip banned.