1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Google Trends scraper - Interested?

Discussion in 'Black Hat SEO' started by superman100, Dec 10, 2009.

  1. superman100

    superman100 Junior Member

    Joined:
    Feb 14, 2009
    Messages:
    169
    Likes Received:
    381
    Occupation:
    I make money
    Hey guys,

    I'm currently building a very basic Google Trends Scraper, which will fetch the current top 40 most searched terms every hour and store them into a database.

    ( www.google.com/trends )

    This data can then be used to create autoblogs, twitter updates, etc. to quickly gain traffic from the trending topics.

    Is there anyone here that would like to access this kind of data? What kind of features would you like to see?

    Let me know before I create a user friendly version (I'll be free, of course!)

    Post here if you're interested and i'll update things as we go...

    Cheers!
     
    • Thanks Thanks x 28
    Last edited: Dec 10, 2009
  2. Ontopic

    Ontopic Registered Member

    Joined:
    Aug 18, 2009
    Messages:
    74
    Likes Received:
    3
    Yeah, could be interesting.
     
  3. thestrangefruit

    thestrangefruit Regular Member

    Joined:
    Jan 25, 2009
    Messages:
    204
    Likes Received:
    27
    Def. would be interested.
     
  4. superman100

    superman100 Junior Member

    Joined:
    Feb 14, 2009
    Messages:
    169
    Likes Received:
    381
    Occupation:
    I make money
    Alright! How would you use it? You don't need to explain in depth but I need good feedback to create the best service possible!
     
  5. otobse

    otobse Power Member

    Joined:
    Aug 30, 2009
    Messages:
    533
    Likes Received:
    75
    i am also interested in it
     
  6. rickstar

    rickstar Elite Member

    Joined:
    Dec 9, 2009
    Messages:
    1,979
    Likes Received:
    871
    Home Page:
    Could be interesting but what exactly are you going to be scraping? The articles from the top 40 items or?
     
  7. superman100

    superman100 Junior Member

    Joined:
    Feb 14, 2009
    Messages:
    169
    Likes Received:
    381
    Occupation:
    I make money
    Lets say I'll scrape the 40 most searched (per hour) terms and save them into a database each hour. Then, every day group them together to retrieve the most popular search term that day.

    I suppose I could retrieve the numbers of results in Google based on the data to determine if there would be a lot of competition in the search engine results for that specific keyword.

    Or, you could just fetch the data from me by rss (or however you guys would prefer.) and create autoblog content.

    Don't know, just thinking loud I suppose.
     
  8. carsonrathi

    carsonrathi Senior Member

    Joined:
    Mar 12, 2008
    Messages:
    1,106
    Likes Received:
    759
    This kind of product is already on the way :)
     
  9. superman100

    superman100 Junior Member

    Joined:
    Feb 14, 2009
    Messages:
    169
    Likes Received:
    381
    Occupation:
    I make money
    Is it something you're working on? If so, hit me up by PM and tell me more :)
     
  10. superman100

    superman100 Junior Member

    Joined:
    Feb 14, 2009
    Messages:
    169
    Likes Received:
    381
    Occupation:
    I make money
    Cool. But, I do however plan to offer the service for free. Freemium is the future of web services and online marketing :)

    Hit me up by PM if you want to cooperate.

    And all others reading: If you would like a FREE version, post a reply in this thread and let me know what kind of features you would love to see!

    CHEERS
     
  11. sandycat

    sandycat Junior Member

    Joined:
    May 20, 2009
    Messages:
    189
    Likes Received:
    66
    Hi Superman,

    I'd like to play with this too! Thanks for sharing
     
  12. superman100

    superman100 Junior Member

    Joined:
    Feb 14, 2009
    Messages:
    169
    Likes Received:
    381
    Occupation:
    I make money
    Thanks so far guys - As we speak i've started to collect the data, so I will be able to launch some sort of preview/beta in a few days (it's a bit useless without the data, so i'll have to wait for a few days.)

    As Google Trends updates every 60 minutes and there are 24 hours in a day i'll store about 960 keywords a day - then group them together so you'll get a rundown on a daily basis about the most popular / searched terms for that day.

    Would you prefer a invite only model or public beta / preview?
     
  13. axedbydax

    axedbydax Power Member

    Joined:
    Sep 16, 2008
    Messages:
    733
    Likes Received:
    171
    Home Page:
    this is a very promising service. I hope to get a copy once its done.
     
  14. superman100

    superman100 Junior Member

    Joined:
    Feb 14, 2009
    Messages:
    169
    Likes Received:
    381
    Occupation:
    I make money
    axedbydax: You will! :) Keep following this thread and let me know what kind of features you would like to see and how you will use it and i'll let you guys know once it's ready.

    as I just wrote: already collecting data... :)
     
  15. mejohnny

    mejohnny Newbie

    Joined:
    Oct 13, 2009
    Messages:
    5
    Likes Received:
    0
    I'm interested. I would suggest invite.
     
  16. sapik

    sapik Newbie

    Joined:
    Nov 23, 2009
    Messages:
    16
    Likes Received:
    0
    can help testing maybe also programming?
     
  17. Blueprint

    Blueprint Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 10, 2009
    Messages:
    286
    Likes Received:
    117
    Location:
    Online
    THis would be very interesting, and again i'd agree with people on saying it should be by invite....
     
  18. MasterSavant

    MasterSavant Registered Member

    Joined:
    Jul 14, 2009
    Messages:
    73
    Likes Received:
    97
    Occupation:
    Professional Bum
    Location:
    Mars
    Hey superman, would love to get a review copy whenever it's done.

    Features I'd love to see:

    - Weekly aggregate of top 100 keywords - 500 keywords
    - Monthly aggregate of top 100 keywords - 500 keywords
    - Personalized graphing capabilities (ie, if you wanted to see a picture representation of the progress of a certain keyword through a certain period of time, etc).

    Similar to Wordtracker's service, this could be used to pick out topic trends - what works all around, what works on a seasonal basis, etc.

    Creating ebooks/courses/packages on popular topics could potentially bring in alot of money.

    In the short-term, this could definitely be used to push traffic to blogs, twitter, etc (again on a very short-term basis).

    Sounds like a cool tool, please definitely keep me updated as to how it turns out.
     
  19. faceicles

    faceicles Newbie

    Joined:
    Dec 10, 2009
    Messages:
    9
    Likes Received:
    1
    Location:
    Florida
    Sounds very cool. I would be interested in this!
     
  20. goawayplease

    goawayplease Regular Member

    Joined:
    Apr 10, 2008
    Messages:
    299
    Likes Received:
    67
    How about a hook into Clickbank and CPA searches to show how to monetize the trends as well? Maybe make the graphing, and the monetization premium features.

    You could also create a content scraping module for content spinners, and make that a premium feature too.