1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Google AdWords Keyword Tool Scraper

Discussion in 'Black Hat SEO' started by madoctopus, Dec 30, 2010.

  1. madoctopus

    madoctopus Supreme Member

    Joined:
    Apr 4, 2010
    Messages:
    1,249
    Likes Received:
    3,498
    Occupation:
    Full time IM
    Hi

    Anybody happens to have a Google Keyword Tool (GKT) scraper in PHP? Or at least know how to build it? I'm pretty good building scrapers but GKT is now AJAX powered and much of the JavaScript is encoded/obfuscated and is giving me headaches.

    I'm willing to pay for a script (preferably a class) or instructions.
     
  2. Success

    Success Newbie

    Joined:
    Feb 13, 2009
    Messages:
    15
    Likes Received:
    4
    not sure if there is any PHP script but market samurai does all analysis of GKT.
     
  3. madoctopus

    madoctopus Supreme Member

    Joined:
    Apr 4, 2010
    Messages:
    1,249
    Likes Received:
    3,498
    Occupation:
    Full time IM
    @Success: I know, but I need it as a PHP class to integrate it with my custom built SEO system.
     
  4. GoTop

    GoTop Junior Member

    Joined:
    Jan 31, 2009
    Messages:
    172
    Likes Received:
    16
    i am looking for this kind of php script too.
     
  5. timothywcrane

    timothywcrane Power Member

    Joined:
    Apr 25, 2009
    Messages:
    590
    Likes Received:
    236
    Occupation:
    Internet Promotion Management
    Location:
    USA
    Home Page:
    Have you thought of using Python? I am not an Uber programmer, and have found microframeworks handy. Check out Sikuli and Flask. Flask is 100% Python and so is Sikuli so you can later clean and refine code without alot of bugs at the cut and paste programmer's level.

    Sikuli will allow you create scripts visually, much like macro recording, but with much more flexibility, and easy integration with other tools in any language. Flask is a simple way to write web applications for your data retrieval, storage, manipulation, and even redeployment and self replication.

    I am sure that if you like php, the same could be done in Limonade or similar.
     
    • Thanks Thanks x 2
  6. blakamia

    blakamia Junior Member

    Joined:
    Jan 25, 2010
    Messages:
    162
    Likes Received:
    343
    I have one in C#. Just finished recoding it today, it now uses pure HTTP GETs/POSTs to automate the tool instead of browser. Average time per query is ~5 seconds. Also comes with a bunch of other tools for checking backlinks, domain age, pr etc... Gonna beta test it some more before giving to anyone. PM me if still interested in buying.
     
  7. tongs

    tongs Newbie

    Joined:
    Sep 14, 2008
    Messages:
    13
    Likes Received:
    54
    I also need a php class
    anyone who can make a class .I will pay for it
     
  8. johndea

    johndea Regular Member

    Joined:
    Jun 23, 2011
    Messages:
    308
    Likes Received:
    35
    I would also be interested in this tool.
    I don't care what language it's in. Please PM me.
     
  9. MyOtherPersona

    MyOtherPersona Newbie

    Joined:
    Sep 13, 2011
    Messages:
    11
    Likes Received:
    2
    Would be interested too. Please send PM with details.
     
  10. akiaki

    akiaki Registered Member

    Joined:
    Aug 8, 2011
    Messages:
    87
    Likes Received:
    10
    Sorry, old thread (except last (clueless?) poster). I'm curious, however, why you wouldn't use the download feature? Seems like you could script that pretty easy(?)
     
  11. madoctopus

    madoctopus Supreme Member

    Joined:
    Apr 4, 2010
    Messages:
    1,249
    Likes Received:
    3,498
    Occupation:
    Full time IM
    no. it is very difficult to script that in PHP. google uses obfuscated javascript for the whole thing.

    If somebody can code a PHP class for this PM me, I pay nice money for it. I'm a PHP coder myself but have no patience to reverse engineer Google's javascript.
     
  12. jkwilson78

    jkwilson78 Regular Member Premium Member

    Joined:
    Jun 24, 2010
    Messages:
    224
    Likes Received:
    311
    I have a php based script that scrapes Google's Keyword tool. I haven't really considered selling it but if there is enough interest I might consider it.

    What would you guys think something like that is worth?

    I actually have two versions.

    Version 1)

    - scrapes Google Keyword tool when logged out
    - solves captcha automaticallly using decaptcher
    - proxy support
    - still able to grab the same data as if you were logged in (ie you can get cpc data even if not logged in.


    Version 2)

    - same as the first version but logs in through accounts so it is a lot faster. No captcha to solve. I have about 500 accounts I use and it will scrape close to a million keywords/day rotating through the differnt accounts and proxies

    Just to be clear, that million is total keywords extracted, not a million individual keywords plus all their suggestions

    Both versions write the data to a mysql DB which makes it easy to tie in to existing scripts and systems through mysql queries.

    They do some other things as well but I'm not sure I can even post something like this here so I won't explain further...that and this is my first post people might beat me with a stick :)

    I'd have to clean it up to be made a little more user friendly.

    I will say it is a pain in the butt to keep up to date. Google changes stuff about every 10-14 days to break the script.

    The fix is usually easy but it does get annoying.

    Let me know if there is any interest.
     
    • Thanks Thanks x 1
  13. danielsun174

    danielsun174 Newbie

    Joined:
    Nov 30, 2009
    Messages:
    28
    Likes Received:
    24
    Home Page:
    hey jkwilson78: could you please contact me in skype (danielsun174). i want to buy your script.
     
  14. dpt321

    dpt321 Newbie

    Joined:
    Sep 20, 2011
    Messages:
    4
    Likes Received:
    0
    I also want this tool if anyone has one pm me price and details.
     
  15. jkwilson78

    jkwilson78 Regular Member Premium Member

    Joined:
    Jun 24, 2010
    Messages:
    224
    Likes Received:
    311
    Hey Guys,

    I am in the process of moving and selling my house so I haven't had time to get the script in a shape that would be purchase friendly.

    Once we get settled in after the move I will try and get something together.
     
  16. bigbag

    bigbag Newbie

    Joined:
    Apr 30, 2008
    Messages:
    47
    Likes Received:
    50
    Any updates on this? Me and I'm sure other people are very interested. :)
     
  17. ILoveCSharp

    ILoveCSharp Regular Member

    Joined:
    Nov 2, 2011
    Messages:
    368
    Likes Received:
    45
    i used logged in account and imacros with firefox
    but after a while google blocks your account from scraping. still you can scrape like 100x800 keywords at total :)

    changing ip does not work when this happened
     
  18. tilya

    tilya Newbie

    Joined:
    May 22, 2012
    Messages:
    1
    Likes Received:
    0
    hi, jkwilson78.

    I'd like buy this script. PM me or reply to "itrepachko_at_gmail_dot_com", please.
     
  19. proweb

    proweb Regular Member

    Joined:
    Feb 24, 2011
    Messages:
    291
    Likes Received:
    144
  20. theMagicNumber

    theMagicNumber Regular Member

    Joined:
    May 13, 2010
    Messages:
    345
    Likes Received:
    195
    Isn't the API paid ? It may cost you thousand of dollars for such amount of keywords