What improvements I can do for my website

from what i saw ... and it was only a quick look

I cannot see a title tag ... the h2 tag is rather lame ... and the website description could improve a lot ... the rest of it I didn't have time to go thru, but I'm sure there is plenty of on-page improvements initially ..

Hope that helps a little
Respect
Goldie...

Nice site, I like it.
Couple of things I would say:

1. validate the site - it has some errors on it.
2. Optimize speed - http://analyze.websiteoptimization.com/wso - check here for info on your sites load time. You might benefit from using sprites (google it).
3. basic SEO - I noticed a few things, like in your title tags you have stuff like "Category Archives: Weird & Funny Facts" I would say put that the other way round - you dont want "catagory archives" at the start of your page title.
4. Your site scores 6.2 on nibbler - http://nibbler.silktide.com/reports/www.coolfacts.in - go through all of the notes here and recommendations and start changing things - I know people say Nibbler is a bit of a gimmick, but it provides very useful information.

Once you have done all that basic stuff (in fact whilst your doing it) get reading AND making friends on BHW!!!

I can see from your page source you have the keywords and the meta description in place which is a good start, based on the onpage SEO as mentioned you need the missing head title sorted out. You have way to many keywords as well you need to lose some. You need to have the main keyword as H1 H2 H3 titles.

I would add a custom logo (just a different font using a font-face plugin on wp).

You could also switch the commenting to Facebook commenting (there is a wp plugin for that too).