[GET] Google and Twitter Trends Scraper

[macdonjo3]

After being requested, I made a simple bot to scrape today's Google and Twitter trends into a CSV file. This is a very simple app. After you open it, it will save the trends.csv to the same directory of the app, so be sure to unzip it. Once you have the csv, you can open it in Excel and play with the data. For example, by removing rows with the "@" symbol if you don't want Twitter people, or removing the "#". This should work on Windows machines of both 32/64 bit. Let me know if you have any bugs.

This app scrapes trends in: Australia, Canada, USA and UK.

Download: https://www.mediafire.com/?mbga01t66iteruj

Let me know if you want any features added. I won't add any features until they're requested multiple times. The app was so simple, I didn't think it needed a GUI. It is a console app.

 

[mseostrategy]

Thanks OP

https://www.virustotal.com/en/file/06386feef5eb681ef1efc45717a8f0de203a075be49d9b1a0c7553b18af97e26/analysis/1389892115/

SHA256: 06386feef5eb681ef1efc45717a8f0de203a075be49d9b1a0c7553b18af97e26
File name: dist.zip
Detection ratio: 0 / 48
Analysis date: 2014-01-16 17:23:17 UTC ( 0 minutes ago )

Clean

 

[macdonjo3]

Thanks OP

Beware Total Virus found malicious malware.


URL: http://www.mediafire.com/download/mbga01t66iteruj/dist.zip
Detection ratio: 2 / 51
Analysis date: 2014-01-16 16:43:04 UTC ( 0 minutes ago )

Interesting. I wonder what's causing it. Looking into this.

Edit: Nvm, I thought you said my file had a virus in it. You just scanned the MediaFire url and 2 items in VT said MediaFire is malicious, but I think everyone here uses MediaFire. If facepalm memes were still in style, I'd put one here. If people want to see the file scanned, here it is:
https://www.virustotal.com/en/file/...e49d9b1a0c7553b18af97e26/analysis/1389892115/

mseostrategy, just a tip for the future: before calling someone out, may it be on BHW or in real life, you better damn well be sure you know what you're talking about. In this case, you clearly don't.

 

[SmokingShawn]

Thanks OP, this will come in handy

 

[Jeffreyy]

Thanks OP, great tool

 

[Renegade88]

Awesome share, thanks for the tool, simple but can be very handy

 

[Mrrippley2]

interesting!, thanks for the share, simple and functional

 

[macdonjo3]

Has anyone had any problems running it? Happy that it is working for all of you.

 

[HelloInsomnia]

Has anyone had any problems running it? Happy that it is working for all of you.

I gave it a shot and this is what I get for Google:

Google Trends	Australia	Sunanda Pushkar
Google Trends	Canada	Sunanda Pushkar
Google Trends	United States	Sunanda Pushkar
Google Trends	United Kingdom	Sunanda Pushkar

Shouldn't there be more results? Anyways, thanks for the app either way.

 

[Kuz32]

oh man that's JUST what i was lookng for! Thanks for this one /

 

[macdonjo3]

I gave it a shot and this is what I get for Google:

Google Trends	Australia	Sunanda Pushkar
Google Trends	Canada	Sunanda Pushkar
Google Trends	United States	Sunanda Pushkar
Google Trends	United Kingdom	Sunanda Pushkar

Shouldn't there be more results? Anyways, thanks for the app either way.

Did the new day just start in your timezone? It scrapes today's trends. Therefore, if that's all that's started to trend today, that's all that will show.

 

[HelloInsomnia]

Did the new day just start in your timezone? It scrapes today's trends. Therefore, if that's all that's started to trend today, that's all that will show.

No that was 12:34 PM for me. I just reran it:

Results:

Google Trends	Australia	47 Ronin
Google Trends	Australia	Andy Murray
Google Trends	Australia	Sunanda Pushkar
Google Trends	Canada	Sunanda Pushkar
Google Trends	United States	Sunanda Pushkar
Google Trends	United Kingdom	47 Ronin
Google Trends	United Kingdom	Andy Murray
Google Trends	United Kingdom	Sunanda Pushkar

Trends (US):

http://i.imgur.com/3jH8WkY.png

 

[macdonjo3]

No that was 12:34 PM for me. I just reran it:

Results:

Google Trends	Australia	47 Ronin
Google Trends	Australia	Andy Murray
Google Trends	Australia	Sunanda Pushkar
Google Trends	Canada	Sunanda Pushkar
Google Trends	United States	Sunanda Pushkar
Google Trends	United Kingdom	47 Ronin
Google Trends	United Kingdom	Andy Murray
Google Trends	United Kingdom	Sunanda Pushkar

Trends (US):

http://i.imgur.com/3jH8WkY.png

You're looking at global trends. These are not global trends. We check on .ca, .com, co.uk and .com.au.

 

[mangrogelio]

thank you i will use this in the future..

 

[john1jacob]

Can you explain what exactly is the purpose of this tool?

 

[lisagosh]

I am confused how to use it.
Please explain in detail.

 

[auraita]

downloading, thank you by the way.

edit : well i downloaded no virus but Windows 8 didnt let me run the program (main.exe) , i think i should change some security stuff.

 

[macdonjo3]

downloading, thank you by the way.

edit : well i downloaded no virus but Windows 8 didnt let me run the program (main.exe) , i think i should change some security stuff.

I don't have Windows 8 to test it, sorry. Let me know if you get any message dialogs or anything.

 

[balador89]

I m newbie and I don't know how to run it
please help me

 

[macdonjo3]

I m newbie and I don't know how to run it
please help me

What's your question?