1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How do you guys find your keywords??

Discussion in 'White Hat SEO' started by the_punisher, Aug 21, 2009.

  1. the_punisher

    the_punisher Power Member

    Joined:
    Feb 6, 2008
    Messages:
    506
    Likes Received:
    115
    Like what I mean is where do you get your inspiration from when your making a new website and are looking for money keywords?

    Im asking cause all of the keywords I choose literally suck.. they really do..

    So before i make another keyword mistake i thought id ask you guys .. see if I could get some good ideas.

    Thanks
     
    • Thanks Thanks x 1
  2. Bacanze

    Bacanze Junior Member

    Joined:
    Nov 12, 2008
    Messages:
    150
    Likes Received:
    49
    Occupation:
    Uni student
    Location:
    UK
    To be honest, I usually do keyword research of topics I'm already interested in, makes the entire process of building a site, content, link building etc more enjoying it you actually enjoy the topic. I suggest most people do the same, unlike many silly ebooks.

    Personally I'd usually enter a few generic keywords into tools such as:

    Code:
    http://tools.seobook.com/keyword-tools/seobook/
    https://adwords.google.com/select/KeywordToolExternal
    
    e.g. cars for example, you'll then see many related keyword phrases. Pick several that you'll think look good in terms of traffic, and won't be a nightmare to rank for, then go to Google, see how many results there are for the particular keyword phrases, and examine several of the sites attributes e.g. amount of BL's they have domain age, PR and so on. Finally using your own experience, determine if it's worth ranking for.
     
    • Thanks Thanks x 1
  3. sharessat

    sharessat Registered Member

    Joined:
    May 18, 2009
    Messages:
    51
    Likes Received:
    2
    Occupation:
    Server Administrator Business Owner
    Location:
    Indiana USA
    Home Page:
    I like this idea of choosing something you like or are already interested in. The reason I like this is because it does in fact make it easier to come up with good quality content if you do this. However like me a lot of people creating websites are doing so to make money. That being said some have actual product they have to sell and a lot of them are a part of a affiliate program and have to sell someone else's products or services. So you really in some cases have to choose words that you may or may not enjoy or know a lot about. What I do is choose a seed keyword and work from that. Once that is done I can take the key word drop it in a keyword tool like Google's Free Keyword Tool, and get a list of relevant long tail keywords. Once I have this list I take this keyword list (and here is where the work come in) and run them through Google one at a time. I find the keywords that get searches each month or have an decent average over a 6 to 12 month period and keep the ones that have under 300,000 results returned. I find that using the allintitle:YourKeyword works great to identify money keywords. I hope this helps and feel free to contact me directly if you want more info on how I do this.
     
  4. the_punisher

    the_punisher Power Member

    Joined:
    Feb 6, 2008
    Messages:
    506
    Likes Received:
    115
    i love cell phones and laptops.. and i can write a lot on them... but for some keywords i rank really well. They dont generate any affiliate sales and the google adsense CPC for all the related keywords suck.. like $0.4 per click.

    there must be some better way to get good keywords..

    I can rank for keywords.. but the problem is how to get good ones?
     
  5. scubaslick

    scubaslick Regular Member

    Joined:
    Aug 23, 2007
    Messages:
    392
    Likes Received:
    512
    [edit] some of the comments in the code won't make any sense since they were notes to myself about things that may or may not appear in the final code. Sorry for the sloppiness, but this is a big project for me (a non-coder) and I had to capture thoughts as they showed up. The code works, even if my mental machinery doesn't. :)

    I hacked this together out of some scripts I've collected over the years as a brainstorming tool. Basically you create a database and put "seed" keywords in it. Doesn't really matter what the words are, it's more important to have a bunch of them. As a hint, I did a google search for "list of nouns" and tossed a couple thousand into my table.

    The tool reads the keyword out of your database then scrapes the 10 results out of google's suggest tool, basically letting google tell you what people are interested in.

    Then it drops the keywords into a new table for you.

    You can export that table and get keyword ideas, then go and research any that catch your eye through the google keyword tool to see if there's any money to be made on them.

    I have it echoing a bunch of stuff because I'm not really a coder and I needed it to spit stuff out so I could could tell where it was in its processes to debug it. Too lazy to take it all out. Besides, I like being called "boss" all the time. :)

    I can't take any credit for the scraping code. I don't remember exactly where I got it, but I definitely stole it from someone else. Thanks to whoever it was by the way.

    I also borrowed couple of the other functions from php.net and others. All I did was spackle them together and create the functions to run the whole operation off of a database.

    It's designed to be run from the command line, but it also works as a web page. Just change all the \n's to <br> to make it output better on a page.

    Most of the results you get back are useless for making money (clarinet reed mildewed for example). Some of them are great though. Just takes a lot of patience to run them through the keyword tool.

    I'm working on automating that too, but since I'm not a big fan of filling out captchas all day, I'm trying to integrate it with an Adwords account. I don't want to lose one since they're a pain in the ass to get back, so I'm going carefully with that one so as not to piss off Big G.

    I might release that when I'm done with it.

    Anyway, this has been tested, without a proxy, on runs up to 2,000 keywords with no real problems other than getting a term that can't evaluate because it has no results. Just restart the bot and let 'er rip when it dies.

    I also recommend using it in a "normal" way. Run it on a few hundred keywords, then give it a break for a few hours. Start it again.

    It's got a random sleep function in it to keep you from beating the hell out of google's server, but I wouldn't let it run 24/7. That'll eventually get your IP blocked.

    it could use some more work, but I'm leaving it alone for now to try to finish up the overall project.

    Maybe it'll help you out as-is.

    -scuba

    Code:
    <?php
    
    // $iterations = rand(25, 500) //pick some number of keywords to run each time the CRON fires.
    //create a weighting function that says if the number is lower, sleep for a random period between runs that adds up to the total time of the bot allowance. if higher, run faster.
    $iterations = 500; //or use the rand function above
    $dupes = 0;
    $whoops = 0;
    $username="dbaseusername";
    $password="dbasepassword";
    $database="dbasename";
    $seed="";
    
    mysql_connect(localhost,$username,$password);
    mysql_select_db($database) or die( "Unable to select database");
    
    for ($count=0; $count<$iterations; $count++) //count each keyword up to the max as determined by the rand above
    {
    $seed="";
    $seed = getNextKeyWord(); //assign the value returned by the function getNextKeyword to the variable $keyword to be used in function scrapeResults
    echo "THE SEED KEYWORD IS: $seed \n\n";
    $keywordlist = scrapeResults($seed);//execute function scrapeResults using the keyword gathered above to get google suggest results
    saveResults($keywordlist);
    //check the results to see if they already exist in tblSuggest. If not, add them.
    echo "\n\nOk, we're gonna try this one now. Wish me luck, boss. \n\n We're trying to take $seed out of action...";
    updateTBLSeed($seed); //note: if the scrape is successful, that's the point at which tblMaster should have the suggest value changed to true
    echo "Sorry boss... you commented out everything else... just sitting here... <yawn>\n\n";
    echo "\n\n\n\n\n\nSLOWING THINGS DOWN HERE!!!!";
    $slp=rand(3,55);
    echo "\n\n\nSo far I've done about $count runs. There are more to go.\n\n\n";
    echo "\n\n\n\n\n\n\n\nGonna nap for $slp seconds. brb.";
    sleep($slp);
    }
    mysql_close();
    die ("Well, we got ".$dupes." dupes, and ".$whoops." whoops on this run, boss! \nSorry about that!\n\n\n");
    
    	function getNextKeyWord()
    		{
    			$result = mysql_evaluate_array("SELECT pk from tblSeed WHERE suggested !='1'"); //select pk values that have not already been used
    				if ($result == 0)
    					{
    						die("Ran out of Seed Words boss...");
    					}
    			
    			$numRows = sizeof($result); //count the number of results
    			echo "Maybe... \n\nLooks like we got us about: $numRows rows, boss \n\n";
    			$id=rand(0,$numRows); //generate a random number between 0 and count_of_rows in the database.
    			$query = "select keyword from tblSeed where pk = \"".$result[$id]."\""; //define the pk as the $id_th array element in a query to get the keyword out of the dbase
    			$nextkey = mysql_evaluate($query);
    				if ($nextkey=="undefined")
    					{
    					die ("Got an undefined here from function mysql_evaluate, boss");//get the keyword
    					}
    			else echo "Got one: $nextkey \n\n";
    			return $nextkey; //send it back to the function call
    		}
    		
    	function mysql_evaluate_array($query) 
    		{
    			$result = mysql_query($query);
    			if (!$result) 
    				{
    					die('AAAAARGH. mysql_evalute_array function Could not query:' . mysql_error());
    				}
    			$values = array();
    			for ($i=0; $i<mysql_num_rows($result); ++$i)
    			array_push($values, mysql_result($result,$i));
    			return $values;
    		}
    		
    	function mysql_evaluate($query, $default_value="undefined") 
    		{
    			$back = mysql_query($query);
    			if (mysql_num_rows($back)==0)
    			return $default_value;
        else
    			return mysql_result($back,0);
    		}
    
    
    function scrapeResults($keyword)
        {
    
            $ch=curl_init();
            $useragent="Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1"; 
            curl_setopt($ch, CURLOPT_USERAGENT, $useragent); 
            curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, false); 
            curl_setopt($ch, CURLOPT_RETURNTRANSFER  ,1);
            curl_setopt($ch, CURLOPT_URL,"http://clients1.google.com/complete/search?hl=en&q=".urlencode($keyword));        
            curl_setopt($ch, CURLOPT_REFERER,"http://www.google.com/webhp?complete=1&hl=en");
            $data=curl_exec($ch);
            curl_close($ch);
            $data=substr($data, strpos($data,"[[")+1);
            preg_match_all("/\[\"(.*?)\",\"(.*?) results/si", $data, $out);
            return($out[1]);
          
           
        }
    
    
    	function saveResults($list)
    		{
    			
    			for ($i=0;$i<sizeof($list); $i++)
    				{
    					echo "Slapping this on into the dbase, boss: ".$list[$i]."\n\n";
    					$query = "INSERT IGNORE INTO tblSuggest (keyword) VALUE ('$list[$i]')";
    					mysql_query($query);
    						
    				}
    		}
    		
    		function updateTBLSeed($seed)
    	{
    		$query = "UPDATE tblSeed SET suggested = '1' WHERE keyword ='$seed'";
    		mysql_query($query);
    		echo "Took this one off the list, boss: $seed \n\n";
    		$cleared=mysql_evaluate("select suggested from tblSeed where keyword = '$seed'");
    		if ($cleared > 0)
    			{
    				echo "It's set to $cleared!!!\n\n";
    			}
    		else
    			{
    				echo "Dang. It's still: $cleared...\n\n";
    			}
    	}
    ?>
     
    • Thanks Thanks x 3
    Last edited: Aug 21, 2009
  6. Bacanze

    Bacanze Junior Member

    Joined:
    Nov 12, 2008
    Messages:
    150
    Likes Received:
    49
    Occupation:
    Uni student
    Location:
    UK
    Very cool scubaslick, I'm also a coder myself, but I focused in others areas than keyword research. Anyway that's a nice idea, you could take it a lot futhre it you wanted, especially if you enjoy programming. For example, you could either manually or automatically 'Google' your spawned keyword phrases, grab the first 10 results, create some sort of algorithm that calculates the sites 'strength' (backlinks, domain age, keyword in title tag etc) then cross reference this with the estimated amount of searches that particular phrase.

    Finally you'll have your keyword search per month number, + your own score which deems how easy it would be to rank for the keyword. Then it's a case of another algorithm involving basic arithmetic to determine on a scale of 1 - to 10 if you should target the keyword phrase, kinda like a ROI estimator.

    Anyway this is probably off topic, I'm a little intoxicated, so this might not make much sense, but I wouldn't mind doing something like this once my ballistic tool is finished :).
     
    • Thanks Thanks x 1
  7. h@cker

    h@cker Junior Member

    Joined:
    Apr 28, 2009
    Messages:
    121
    Likes Received:
    36
    Occupation:
    IM in the making
    Location:
    MatrIX
    ^
    Market Samurai Does all these things
     
  8. magpie2419

    magpie2419 Regular Member

    Joined:
    Mar 27, 2009
    Messages:
    313
    Likes Received:
    343
    Occupation:
    Millionaire
    Location:
    Newcastle UK Or Morocco
    You should probably look at something like Micro Niche Finder, the research it does is first class, it will give you all sorts of information about your keywords. You really cannot fail to find good keywords when using it. After it has finished it exports directly to excel or txt file. I will run laptops through it and shoot you a PM when I have time.
     
  9. blackieman

    blackieman Power Member

    Joined:
    Jan 28, 2008
    Messages:
    762
    Likes Received:
    79
    The process is you first look for niches that are trending up. The way to find them is thru ebay, shopping.com, lycos, yahoo (see this ref, remove * h**ttp://www.classifiedsforfree.com/free/5-steps-to-finding-a-niche-for-making-money-online/).

    Then I recommend a good keyword research tool. I use Market Samurai, and it actually give you 'total SEO value' for every keyword, which is the multiplication of seo traffic x adwords click value. So that is pretty good. Micro Niche Finder is said to be good too, but I have not used it. Keyword Elite is good too... I use KE, because it gives me a ton more obscure keywords.

    For best graphical brainstorming, search in google, and near top left, click on 'show options' and click on 'wonder wheel' on left bar. This is a new tool, and shows you how things are interconnected.

    I think where you might be failing is not researching the adword click value.
     
  10. scubaslick

    scubaslick Regular Member

    Joined:
    Aug 23, 2007
    Messages:
    392
    Likes Received:
    512
    Lol. This is exactly what I'm doing.

    I've already got the PR scraper finished, as well as having it grab the first 10 urls and check out the page title and keywords they're targeting. So it takes my base word, pulls the top 10, gets the PR of the top ten, plus the title and keywords, then dumps it all back in so I can analyze it.

    I'm working on an algorithm for competition level vs. potential return, but I'm not much of an seo guy. I have some ideas floating around in the old bean though, so we'll see how it goes.

    I've heard good things about market samurai, I'll have to check it out if I can find it. MNF is a great product but I haven't found a fully capable cracked version yet, and I'm not shelling out the cash for it until I test it fully.

    KE is good too, but it always seems to shit on itself before I get any decent data out of it.

    I've also got another SEO tool I bought called Trendmetrix. It's a good tool but it's overly complex for what I need. I'm really trying to put together a process, rather than create a product, and i wanted to learn how to build this stuff, so...

    Anyway, back to the lab. <mad scientist cackle>

     
  11. kennick

    kennick Newbie

    Joined:
    Feb 10, 2009
    Messages:
    27
    Likes Received:
    8
    Occupation:
    Retired
    Location:
    Brisbane,Australia
    Home Page:
    Adwords Analyzer is another good tool. You can find it here in he download section.
     
  12. sandchica

    sandchica Regular Member

    Joined:
    Sep 25, 2008
    Messages:
    223
    Likes Received:
    235
    Products work well for me. Not IM products but things people use every day.

    Skin care products
    Household products
    Sports products
    Electronics -extreme keyword research is essential here but i did quite well with digital cameras maybe try niches like underwater cameras or cameras for kids.

    I have sold thousands of consumer products and maybe only a handfull of IM stuff. For me they are much easier to promote.
     
  13. whtgryblk

    whtgryblk Newbie

    Joined:
    Aug 14, 2008
    Messages:
    41
    Likes Received:
    20
    Occupation:
    Digital Entrepreneur
    Location:
    Miami
    My keyword research begings with researching a niche first..... so step one would be to go to a few of the sites below and get a feel of peoples needs & problems( make notes of these problesm)...and once you see trends.... across various sites..... make notes...once a market with needs is found..I go back a review the types of answers and solutions ,cures that they are looking for ..the types of questions they are asking...and I take that info and create my own keyword lists...Its tons of work..but the best keyword tool in the world is your Brain... plus I find the keywords created from this research convert much much easier than automated tools...plus it gives a better idea of which offers to throw at them... to get you started in my niche approach to keyword generation checkout the sites below

    Code:
    http://en.wikipedia.org/wiki/Category:Future_products
    http://www.webmd.com/default.htm
    http://downloads.zdnet.com/topsearch.aspx
    http://azlist.about.com/
    http://buzz.yahoo.com/buzzlog/
    http://www0.shopping.com/top_searches
    http://www.seomoz.org/popular-searches/index/2009-08-11
    http://www.43things.com/zeitgeist/popular_goals
    
     
    • Thanks Thanks x 2
  14. blackieman

    blackieman Power Member

    Joined:
    Jan 28, 2008
    Messages:
    762
    Likes Received:
    79
    Another approach is to go to goog external keyword tool, and type
    get rid of
    cure
    fix
    help
    relieve
    maintain
    better
    ...

    and see what keywords are popular with this. This is the NEED category.
     
  15. BozoClown

    BozoClown Junior Member

    Joined:
    Jan 4, 2009
    Messages:
    150
    Likes Received:
    106
    MNF is definitely a winner. I use my own tool inspired by MNF as you can tell from the thumbnail.

    [​IMG]

    I needed something that worked on linux and I wanted a couple of changes and additions to MNF to suit my style.
     
  16. Goodvin211

    Goodvin211 Junior Member

    Joined:
    Dec 23, 2007
    Messages:
    111
    Likes Received:
    20
    Products work well for me
    Skin care products
    Household products

    Market Samurai
     
  17. neo

    neo Power Member

    Joined:
    May 5, 2007
    Messages:
    500
    Likes Received:
    365
    In business market always come first.
    See what people are buying and what products are being sold (amazon, ebay pulse, shopping.com). Start your keyword results with those see niches.
     
    • Thanks Thanks x 1
  18. stingow

    stingow Registered Member

    Joined:
    Nov 20, 2008
    Messages:
    61
    Likes Received:
    18
    I use micro niche finder to get my keywords and good ideas for niches. I hate to pay for anything if I dont have to but I am really glad I got this. This tool is so much more than a good keyword finder and I am finding I use it nearly every day. It may cost a lot but it is well worth the money.
     
  19. Spaceman

    Spaceman Regular Member

    Joined:
    Aug 8, 2009
    Messages:
    435
    Likes Received:
    53
    Its all very well looking at the top ten sites and their titles, I have a program which looks at the content on the domains which are linking to the top ten sites aswell.
    It provides 66 different element statistics of linking pages (as well as stats for the ranking pages).

    Does this help?
    Not me it didnt and it took me ages to write.

    Grim.
     
  20. the_punisher

    the_punisher Power Member

    Joined:
    Feb 6, 2008
    Messages:
    506
    Likes Received:
    115
    Bozoclown, spaceman , how about sharing these programs ?