hacko
BANNED
- Feb 3, 2010
- 912
- 976
Been thinking about writing this one for the past month or so and finally decided to get to it. It's written mostly for the BHW community, but also for my blog.
There are so many misconceptions when it comes to keywords and the keyword research process. People are treating SEO like it’s some sort of luck game when it really isn’t. Know what you’re doing and you’ll see patterns and consistent results most of the time. Easier said than done nevertheless, but keyword research is definitely something you should be paying more attention to. Build a site around the wrong keywords and no link package will save you – been there, done that.
In this article I’m going to talk about some practical ways of finding good keywords and keeping the good ones, without getting too side-tracked. I’m going to focus on a few key tools – these are in no way my entire arsenal, but they can definitely get much of the job done. This should be enough to have you on the right track of doing your keyword research properly. Anyway, let’s get started.
Expectations
First things first, before you start your keyword research, you need to get real. There is no magical 10,000 US monthly searches buyer intent keyword for a $500 product, or anything similar. I’m yet to see one of those in 2+ years of ACTIVE keyword research, yet newbies come and ask me to find them these “gems”. There isn’t some secret club where someone all holds all keywords like these (regardless of what some sellers would say) – and if there is, I’m certainly not a member.
Also, don’t expect to find keywords that none of your competitors would have ever heard about. If it has the monthly searches, it means that enough people are putting that into the little Google search box. And if enough people are doing that, why would you think that none of your competitors would have thought of that particular keyword as well?
Found some huge MS keyword that all the tools say is “low competition”? I’ll take a wild guess and say that’s it’s an ecommerce keyword that HUGE, million (or even billion) dollar business are ranking for with their category pages (don’t confuse category pages with product pages – those are way easier to outrank). Some overpriced tool like Long Tail Pro might say that it’s “low competition” because it has 0 links or whatever it is they account for today with their ridiculous formula, but it won’t be even close. If something looks too good to be true, it is.
What you CAN hope for is finding keywords that not too many of your competitors know about or are targeting, or keywords that are mostly targeted by pages with either bad onpage, a lack of links, or both.
Short/Long Term Keywords
I mean short/long not so much in terms of time, but more as a way to separate the keywords that you will be able to rank faster (short term) vs the keywords that you can rank for eventually (long term).
I don’t see this discussed often at all, yet I think it’s quite crucial when building a site. This part goes hand in hand with silo structure, so if you don’t know much about that you better read some https://www.blackhatworld.com/seo/what-is-silo-small-explanation-i-would-have-loved-some-time-ago.972588/
I’m going to shamelessly steal the image from @BlackBDO 's post above:
**removed**
Without going into too much detail about silo, here are a few points regarding short/long term keywords:
Keyword ideas
Before you start targeting a niche, you should definitely get familiar with it first. Do the products go by any other names (for example, British vs American English, slang words, etc)? Is there a super related product that you could be targeting?
Try to get as many keyword ideas as you can. This is where I’m going to mention the AdWords Keyword Planner – even though I currently don’t see another use of it and I’d say you’re better off without it. Something I find more useful is simply LSIGraph.com – finding words semantically related can help a ton with your research. LSIGraph can also come in handy for on-page optimization, but that’s a whole other topic.
Another [VERY] simple trick you can use to come up with more keyword ideas is simply scrolling to the bottom of the Google search results and copying their “related” searches terms.
**removed**
How NOT to look for keywords to target
Every keyword research tool that I’ve tried can be good for two things only – getting the monthly searches (now that the almighty Google doesn’t reveal them to the average mortals) and filtering out high competition keywords. Other than that, tools like KWFinder fail horribly at coming up with new keywords to target in your niche. I am going to talk more about KWFinder and what it can be useful for later on, but this is definitely not its best usage. In fact, all the KWFinder “Suggestions” option does is shamelessly take the same results the Google AdWords Keyword Planner provides. Don’t believe me? Here’s what both of them have to output when you input “keywords”
**removed**]
Oh, and they both conveniently provide just 554 results for the term “keywords”. Shocking, I know.
KWFinder and blindly trusting competitiveness “scores”
Let’s talk about competitiveness formulas. I’m guilty of using Long Tail Pro in the past, until I realized it’s good for nothing. My tool of choice right now is KWFinder, although I already mentioned that it isn’t the best for coming up with keyword ideas. Apart from that, their “queries per 24 hours” thing is total rip off, just as their daily limit itself. Let’s say you haven’t used the tool in a couple of days and decide to use it for an hour Sunday night. No matter in which time zone you are, you will have to wait until Monday night until your daily limit resets. This would be fine only if there was a specific server or local reset time. This way, you’re using your Sunday queries (after not using the tool for a couple of days, remember), BUT you have to wait 24 hours until it resets. I guess I went on a bit of a rent about this, it’s just really annoying for a tool that isn’t very cheap in the first place.
You will also need to get the Agency plan if you want to do any real research, otherwise you just won’t have enough queries. Aaand, they often have “connection problems” that will make you pull your hair out while trying it for the Nth time. Oh, and did I mention that their Black Friday deal was so unjust to current customers that I had to downgrade and then upgrade again to basically pay them $60 just so they would treat me with the respect and pricing a new customer would get (but that’s a whole different story).
Not everything is horrible though, and what KWFinder is actually good for is getting rid of high competition keywords and providing monthly search volumes. Their filtering options come in handy as well, even though there isn’t a button to mass check competitiveness for keywords since they’re cheap little pricks and they don’t want you to use up your queries. Still, I’m yet to find a better alternative to get a certain part of my filtering process done.
The KWFinder Competitiveness Formula
I spent a few extra hours in the office trying to reverse engineer this, and so I did. I think it’s crucial to understand their competitiveness formula so that you can also understand what they take into consideration the most, why it’s flawed and what you can actually use it for. Other tools’ competitiveness formulas are often similar, but nevertheless neither will be perfect.
Basically, KWFinder assigns each page a “rank”, based on four metrics. Then they take the average rank of each page and that’s their “SEO Difficulty”
**removed**
The four metrics they use to get the Rank of each page are: Domain Authority, Page Authority, Moz Rank and Moz Trust.
Even though I wasn’t able to get it 100%, their formula looks roughly like this:
In other terms, these are the weights they give to each of these four metrics:
When we plug this formula in Excel for the top results for the term “keyword research”, we get the following:
**removed**
This is as close as I could get to the original formula, but as you can see, results in column G are almost the same as column F, with a few exceptions. These doesn’t mean much when we calculate the total average - I was just one point off KWFinder’s score of 68.
This means a few things. First of all, these are all Moz metrics. This means that KWFinder relies solely on Moz data in order to calculate keyword difficulty. Then, they give the most value to Page Authority – which I essentially agree with.
However, that doesn’t mean that PA is a perfect metric. We all know that you can block the SEOMoz crawler if you’re using PBNs. This would mean that a certain result could actually have tons of links, yet Moz may not see any of them – the KWFInder Rank for this result will be very low, thus lowering the average competitiveness score of the keyword. This is what I call a false positive low competition keyword (more about this later). Get enough affiliate websites with hidden links on page 1, and you could get a KWFinder SEO score lower than 20 even, telling you to “Go For It” while in reality you could only go f*ck yourself.
Also, giving Domain Authority a value of 25% without additional conditions can mess things up quite a bit. Let’s say you had a super easy keyword, with nothing 10 YouTube videos on page 1, each having between 10 and 1000 views, nothing else. No links, nothing. According to KWFinder, this keyword would have a competitiveness score of 25, while in reality it should be 0. The keyword will have this score because YouTube.com has a DA of 100 – put that at 25% and each results will have a KWFinder Rank of 25.
Another thing about this formula is that it doesn’t seem to take on-page into consideration at all. I’m not even gonna discuss MozRank and MozTrust, and I don’t know how or why they combined these two to give them 25% of the value in their formula – it looks like it came out of their a** tbh. Anyway, back on track.
Step 1 - Finding keywords and building a list
You should probably use Keyword Planner (or KWFinder’s suggestions, same thing) for the initial ideas and keep whatever it has to provide, just in case you don’t miss out on the few good keywords that it might suggest. However, keep in mind that Keyword Planner is a tool meant to get people to spend money with AdWords. It is NOT an SEO tool, and it is not in their interest to get you the good SEO keywords.
So, how do you actually find good keywords? Remember LSIGraph, the keyword ideas tool I mentioned earlier? Go there and take every word that’s actually related to what you’re looking to target.
There are a few things you can do with these words:
Another little trick you can do is use the Keywords Everywhere chrome extension to get the monthly searches on websites like UberSuggest and KeywordShitter.
**removed**
With KeywordShitter, make sure you don’t input more than one keyword (or at least a few super related ones), or your output is going to be a gigantic mess and you won’t be able to separate the different niches and product types.
**removed**
Just input a keyword into SEMRush, and Export it’s Related Keywords. You can do this for more than one term for optimal results.
**removed**
Once you have a list of URLs, you will need to use the Site Explorer option in Ahrefs. Even though some prefer to use SEMRush for this, I’ve found that Ahrefs provides much more data, whether it’s related to backlink analysis or organic keywords. It’s expensive but worth it – nobody said this was free. Anyway, plug your URLs into Ahrefs one by one, and Export the Organic Keywords these sites are ranking for.
**removed**
Go through all the URLs one by one, and you should have a bunch of csv files you can use. The problem with these is that a lot of keywords will be repeated multiple times, so what you can do is combine all the CSV files you get, and then remove duplicates.
On Windows, you can do this by opening the Command Prompt (Run > cmd), then typing in pushd “directory” – where “directory” is the location of the folder you have all your CSVs in (make sure you don’t have any other ones in there). After this, just type in copy *.csv combine.csv – where combine.csv is the name of the CSV file in which you want all this data combined.
**removed**
After this, all you need to do is copy all the data from the Keyword column, and then remove the duplicates (and possibly empty lines). A simple tool that does this is http://textmechanic.com/text-tools/basic-text-tools/remove-duplicate-lines/
If you did everything right, you should now have a list of hundreds of your competitors’ keywords, as well as Google autocomplete keywords ready to be filtered out.
Step 2 - Filtering the trash and high competition keywords out
Now, this is where KWFinder comes in handy. You should already have a large list of keywords you want to filter out thanks to the tools mentioned above. We want the filtering part of the process because of two reasons – we want to get rid of the keywords with low monthly searches, as well as the obviously high competition ones. I say “obviously” because keyword competitiveness formulas aren’t the greatest thing ever, as we already saw.
First of all, you want to start importing your keywords in KWFinder. You can only import 700 at a time, and you will probably have thousands of them to report. To make this easier, I use a little free tool called TextWedge.
If you go to Dialogs > Configure Standard Splitting, you can split one text file in multiple parts, each containing no more than 700 lines.
**removed**
Then, just navigate to Action > Spilt, and Save Chunks and your 700-line text files will be in your chosen folder (I used the Text Wedge folder where the .exe to run the program is located).
Now, you will start importing these into KWFInder. After each import, add a filter of your choice. I recommend you filter through your results twice – the first time for lower MS, short-term keywords, and the second for your higher MS, long-term keywords. You can save these in Lists that you can organize/filter further later.
For short term keywords, I would do minimum 100 monthly searches (unless you have more expensive products for which lower MS would be worth pursuing) and 35 maximum Difficulty. For my Long-term keywords, I would want 1000+ MS keywords (again, depending on the niche – this is just the low limit) and Difficulty not higher than 45. This is not a written rule, and your filters should be flexible in order to fit your goals. Keep in mind that if you’re applying more than one filter for a certain group of keywords, your filters shouldn’t overlap since you don’t want to be manually looking through keywords twice, as you will have enough work as is. KWFinder (nor any other tool, for that matter) can’t distinguish between keywords Google wouldn’t consider different, such as “keyword research tool”, “tool keyword research” and “tool for keyword research” and you will manually have to sort through these.
**removed**
Now, note that after you apply the filter, you still have to check competitiveness for all of the keywords that are not calculated already. KWFInder only saves a KW in their database for 30 days (or so they say) after it’s difficulty is first calculated, since SERPs often change. You will notice this yourself when you manually go through the keywords – right after you click, it will often show numbers quite different than what was calculated before.
Step 3 - Manually picking through whatever’s left
Once you’ve filtered all of the keywords in your list (which should have been split in 700-line chunks), you want to go through them. There is no easy way of doing this, but the first I recommend doing is removing what is obviously unusable from your lists.
After that, use your common sense to find the best candidates to target as your long term keywords. Note that there WILL BE other affiliate sites on the SERPs for these. Any long term keyword worth pursuing is already known to affiliates. These will include a lot of “best” and “reviews” keywords – doesn’t mean they’ll be bad keywords to target long-term, it just means that you won’t magically appear in SERPs for them right away, which you should expect.
As for your short-term, product-review-type keywords, I tried but couldn’t really come up with a super specific set of rules to follow. However, here are a few things you should and shouldn’t do:
**removed**
**removed**
A few other things worth mentioning
Further Investigation and Keyword Trends
After you’re done manually looking through the SERPs, you should do your own detailed analysis, especially for your long-term keywords. Here are a couple of keywords I found recently – one was for a client, while the other one was for one of my affiliate sites:
**removed**
Now, for both of these keywords it’s important to notice that the searches in the last couple of months are SIGNIFICANTLY higher than the average monthly searches – had I picked different filters, I never would have found these.
However, can you tell which of these keywords would be better one to target? No way you could without further research. So, after looking into these, I found that the first keyword was a $700 product that recently came out. Commission for this would be quite decent, and competition was quite low since the competition didn’t seem to be catching up just yet – surely something my client would love to get.
The second keywords, however – even though it had higher monthly searches and even lower competitiveness, was one that people were only searching for because they were seeing a very particular Facebook ad for it. I checked Google Trends, and as I suspected, the person had already stopped running ads for this product and monthly searches were now close to none. However, KWFinder hadn’t updated the monthly searches after November 2017.
Another thing you should do when further investigating a keyword is finding long tail and LSI keywords (can use LSIGraph.com again here) to target in your article. You will often find hundreds of monthly searches of keywords than can bring extra traffic if you at least mention them in your content – you don’t even necessarily have to be targeting all of them properly. Not only can these bring more visitors, they can also help rank better for the initial keyword , since Google lately is really placing an accent on semantic search.
Alternative keyword research techniques/tools you might want to look into
Here are some other ways you can make your life easier when searching for keywords:
**removed**
The newbie FAQ
This isn’t something I would normally do, but it’s funny to see newbies post the same questions over and over again. So, to answer a few of the questions being frequently asked:
Anyway, it’s day two and 12+ hours of writing this and I’m about 5100 words in. I tried to put this together so it makes as much sense as possible and if anything is unclear, please ask. There’s definitely more to say about keyword research, but let’s save a little more something for later
There are so many misconceptions when it comes to keywords and the keyword research process. People are treating SEO like it’s some sort of luck game when it really isn’t. Know what you’re doing and you’ll see patterns and consistent results most of the time. Easier said than done nevertheless, but keyword research is definitely something you should be paying more attention to. Build a site around the wrong keywords and no link package will save you – been there, done that.
In this article I’m going to talk about some practical ways of finding good keywords and keeping the good ones, without getting too side-tracked. I’m going to focus on a few key tools – these are in no way my entire arsenal, but they can definitely get much of the job done. This should be enough to have you on the right track of doing your keyword research properly. Anyway, let’s get started.
Expectations
First things first, before you start your keyword research, you need to get real. There is no magical 10,000 US monthly searches buyer intent keyword for a $500 product, or anything similar. I’m yet to see one of those in 2+ years of ACTIVE keyword research, yet newbies come and ask me to find them these “gems”. There isn’t some secret club where someone all holds all keywords like these (regardless of what some sellers would say) – and if there is, I’m certainly not a member.
Also, don’t expect to find keywords that none of your competitors would have ever heard about. If it has the monthly searches, it means that enough people are putting that into the little Google search box. And if enough people are doing that, why would you think that none of your competitors would have thought of that particular keyword as well?
Found some huge MS keyword that all the tools say is “low competition”? I’ll take a wild guess and say that’s it’s an ecommerce keyword that HUGE, million (or even billion) dollar business are ranking for with their category pages (don’t confuse category pages with product pages – those are way easier to outrank). Some overpriced tool like Long Tail Pro might say that it’s “low competition” because it has 0 links or whatever it is they account for today with their ridiculous formula, but it won’t be even close. If something looks too good to be true, it is.
What you CAN hope for is finding keywords that not too many of your competitors know about or are targeting, or keywords that are mostly targeted by pages with either bad onpage, a lack of links, or both.
Short/Long Term Keywords
I mean short/long not so much in terms of time, but more as a way to separate the keywords that you will be able to rank faster (short term) vs the keywords that you can rank for eventually (long term).
I don’t see this discussed often at all, yet I think it’s quite crucial when building a site. This part goes hand in hand with silo structure, so if you don’t know much about that you better read some https://www.blackhatworld.com/seo/what-is-silo-small-explanation-i-would-have-loved-some-time-ago.972588/
I’m going to shamelessly steal the image from @BlackBDO 's post above:
**removed**
Without going into too much detail about silo, here are a few points regarding short/long term keywords:
- The review keywords would be considered short term, since you’d be far more likely to rank for those faster, compared to the ones listed below. Easier to rank keywords are important in my opinion, as you can start seeing some page 1 ranks way before you start ranking for your real money keywords.
- Beef dog food, best chicken dog food, best dog food, dog food… - these would be more long term keywords, with some being more long term than others. The further “up” the silo you go, the tougher the keywords – or at least it should be that way. Competition for these (non-review) keywords will be usually higher.
- Before picking the review keywords you’re going to target, I would look at the product names themselves. These would be more long term and slightly harder competitiveness than the review keywords themselves, but still definitely worth targeting as they will have X times the monthly searches of the review keywords and you can rank for these eventually as well.
Keyword ideas
Before you start targeting a niche, you should definitely get familiar with it first. Do the products go by any other names (for example, British vs American English, slang words, etc)? Is there a super related product that you could be targeting?
Try to get as many keyword ideas as you can. This is where I’m going to mention the AdWords Keyword Planner – even though I currently don’t see another use of it and I’d say you’re better off without it. Something I find more useful is simply LSIGraph.com – finding words semantically related can help a ton with your research. LSIGraph can also come in handy for on-page optimization, but that’s a whole other topic.
Another [VERY] simple trick you can use to come up with more keyword ideas is simply scrolling to the bottom of the Google search results and copying their “related” searches terms.
**removed**
How NOT to look for keywords to target
Every keyword research tool that I’ve tried can be good for two things only – getting the monthly searches (now that the almighty Google doesn’t reveal them to the average mortals) and filtering out high competition keywords. Other than that, tools like KWFinder fail horribly at coming up with new keywords to target in your niche. I am going to talk more about KWFinder and what it can be useful for later on, but this is definitely not its best usage. In fact, all the KWFinder “Suggestions” option does is shamelessly take the same results the Google AdWords Keyword Planner provides. Don’t believe me? Here’s what both of them have to output when you input “keywords”
**removed**]
Oh, and they both conveniently provide just 554 results for the term “keywords”. Shocking, I know.
KWFinder and blindly trusting competitiveness “scores”
Let’s talk about competitiveness formulas. I’m guilty of using Long Tail Pro in the past, until I realized it’s good for nothing. My tool of choice right now is KWFinder, although I already mentioned that it isn’t the best for coming up with keyword ideas. Apart from that, their “queries per 24 hours” thing is total rip off, just as their daily limit itself. Let’s say you haven’t used the tool in a couple of days and decide to use it for an hour Sunday night. No matter in which time zone you are, you will have to wait until Monday night until your daily limit resets. This would be fine only if there was a specific server or local reset time. This way, you’re using your Sunday queries (after not using the tool for a couple of days, remember), BUT you have to wait 24 hours until it resets. I guess I went on a bit of a rent about this, it’s just really annoying for a tool that isn’t very cheap in the first place.
You will also need to get the Agency plan if you want to do any real research, otherwise you just won’t have enough queries. Aaand, they often have “connection problems” that will make you pull your hair out while trying it for the Nth time. Oh, and did I mention that their Black Friday deal was so unjust to current customers that I had to downgrade and then upgrade again to basically pay them $60 just so they would treat me with the respect and pricing a new customer would get (but that’s a whole different story).
Not everything is horrible though, and what KWFinder is actually good for is getting rid of high competition keywords and providing monthly search volumes. Their filtering options come in handy as well, even though there isn’t a button to mass check competitiveness for keywords since they’re cheap little pricks and they don’t want you to use up your queries. Still, I’m yet to find a better alternative to get a certain part of my filtering process done.
The KWFinder Competitiveness Formula
I spent a few extra hours in the office trying to reverse engineer this, and so I did. I think it’s crucial to understand their competitiveness formula so that you can also understand what they take into consideration the most, why it’s flawed and what you can actually use it for. Other tools’ competitiveness formulas are often similar, but nevertheless neither will be perfect.
Basically, KWFinder assigns each page a “rank”, based on four metrics. Then they take the average rank of each page and that’s their “SEO Difficulty”
**removed**
The four metrics they use to get the Rank of each page are: Domain Authority, Page Authority, Moz Rank and Moz Trust.
Even though I wasn’t able to get it 100%, their formula looks roughly like this:
Rank = (DA*0.25) + (PA*0.4) + (MR*10*0.22) + (MT*10*0.13)
In other terms, these are the weights they give to each of these four metrics:
- Domain Authority – 25%
- Page Authority – 40%
- Moz Rank (multiplied by 10) – 22%
- Moz Trust (multiplied by 10) – 13%
When we plug this formula in Excel for the top results for the term “keyword research”, we get the following:
**removed**
This is as close as I could get to the original formula, but as you can see, results in column G are almost the same as column F, with a few exceptions. These doesn’t mean much when we calculate the total average - I was just one point off KWFinder’s score of 68.
This means a few things. First of all, these are all Moz metrics. This means that KWFinder relies solely on Moz data in order to calculate keyword difficulty. Then, they give the most value to Page Authority – which I essentially agree with.
However, that doesn’t mean that PA is a perfect metric. We all know that you can block the SEOMoz crawler if you’re using PBNs. This would mean that a certain result could actually have tons of links, yet Moz may not see any of them – the KWFInder Rank for this result will be very low, thus lowering the average competitiveness score of the keyword. This is what I call a false positive low competition keyword (more about this later). Get enough affiliate websites with hidden links on page 1, and you could get a KWFinder SEO score lower than 20 even, telling you to “Go For It” while in reality you could only go f*ck yourself.
Also, giving Domain Authority a value of 25% without additional conditions can mess things up quite a bit. Let’s say you had a super easy keyword, with nothing 10 YouTube videos on page 1, each having between 10 and 1000 views, nothing else. No links, nothing. According to KWFinder, this keyword would have a competitiveness score of 25, while in reality it should be 0. The keyword will have this score because YouTube.com has a DA of 100 – put that at 25% and each results will have a KWFinder Rank of 25.
Another thing about this formula is that it doesn’t seem to take on-page into consideration at all. I’m not even gonna discuss MozRank and MozTrust, and I don’t know how or why they combined these two to give them 25% of the value in their formula – it looks like it came out of their a** tbh. Anyway, back on track.
Step 1 - Finding keywords and building a list
You should probably use Keyword Planner (or KWFinder’s suggestions, same thing) for the initial ideas and keep whatever it has to provide, just in case you don’t miss out on the few good keywords that it might suggest. However, keep in mind that Keyword Planner is a tool meant to get people to spend money with AdWords. It is NOT an SEO tool, and it is not in their interest to get you the good SEO keywords.
So, how do you actually find good keywords? Remember LSIGraph, the keyword ideas tool I mentioned earlier? Go there and take every word that’s actually related to what you’re looking to target.
There are a few things you can do with these words:
- Use keyword generators based on Google autocomplete, such as UberSuggest.io, KeywordTool.io or KeywordShitter.com
Another little trick you can do is use the Keywords Everywhere chrome extension to get the monthly searches on websites like UberSuggest and KeywordShitter.
**removed**
With KeywordShitter, make sure you don’t input more than one keyword (or at least a few super related ones), or your output is going to be a gigantic mess and you won’t be able to separate the different niches and product types.
- Use Scrapebox’s Keyword Scraper
**removed**
- Use SEMRush’s related keywords option
Just input a keyword into SEMRush, and Export it’s Related Keywords. You can do this for more than one term for optimal results.
**removed**
- Stealing your competitors’ keywords
Once you have a list of URLs, you will need to use the Site Explorer option in Ahrefs. Even though some prefer to use SEMRush for this, I’ve found that Ahrefs provides much more data, whether it’s related to backlink analysis or organic keywords. It’s expensive but worth it – nobody said this was free. Anyway, plug your URLs into Ahrefs one by one, and Export the Organic Keywords these sites are ranking for.
**removed**
Go through all the URLs one by one, and you should have a bunch of csv files you can use. The problem with these is that a lot of keywords will be repeated multiple times, so what you can do is combine all the CSV files you get, and then remove duplicates.
On Windows, you can do this by opening the Command Prompt (Run > cmd), then typing in pushd “directory” – where “directory” is the location of the folder you have all your CSVs in (make sure you don’t have any other ones in there). After this, just type in copy *.csv combine.csv – where combine.csv is the name of the CSV file in which you want all this data combined.
**removed**
After this, all you need to do is copy all the data from the Keyword column, and then remove the duplicates (and possibly empty lines). A simple tool that does this is http://textmechanic.com/text-tools/basic-text-tools/remove-duplicate-lines/
If you did everything right, you should now have a list of hundreds of your competitors’ keywords, as well as Google autocomplete keywords ready to be filtered out.
Step 2 - Filtering the trash and high competition keywords out
Now, this is where KWFinder comes in handy. You should already have a large list of keywords you want to filter out thanks to the tools mentioned above. We want the filtering part of the process because of two reasons – we want to get rid of the keywords with low monthly searches, as well as the obviously high competition ones. I say “obviously” because keyword competitiveness formulas aren’t the greatest thing ever, as we already saw.
First of all, you want to start importing your keywords in KWFinder. You can only import 700 at a time, and you will probably have thousands of them to report. To make this easier, I use a little free tool called TextWedge.
If you go to Dialogs > Configure Standard Splitting, you can split one text file in multiple parts, each containing no more than 700 lines.
**removed**
Then, just navigate to Action > Spilt, and Save Chunks and your 700-line text files will be in your chosen folder (I used the Text Wedge folder where the .exe to run the program is located).
Now, you will start importing these into KWFInder. After each import, add a filter of your choice. I recommend you filter through your results twice – the first time for lower MS, short-term keywords, and the second for your higher MS, long-term keywords. You can save these in Lists that you can organize/filter further later.
For short term keywords, I would do minimum 100 monthly searches (unless you have more expensive products for which lower MS would be worth pursuing) and 35 maximum Difficulty. For my Long-term keywords, I would want 1000+ MS keywords (again, depending on the niche – this is just the low limit) and Difficulty not higher than 45. This is not a written rule, and your filters should be flexible in order to fit your goals. Keep in mind that if you’re applying more than one filter for a certain group of keywords, your filters shouldn’t overlap since you don’t want to be manually looking through keywords twice, as you will have enough work as is. KWFinder (nor any other tool, for that matter) can’t distinguish between keywords Google wouldn’t consider different, such as “keyword research tool”, “tool keyword research” and “tool for keyword research” and you will manually have to sort through these.
**removed**
Now, note that after you apply the filter, you still have to check competitiveness for all of the keywords that are not calculated already. KWFInder only saves a KW in their database for 30 days (or so they say) after it’s difficulty is first calculated, since SERPs often change. You will notice this yourself when you manually go through the keywords – right after you click, it will often show numbers quite different than what was calculated before.
Step 3 - Manually picking through whatever’s left
Once you’ve filtered all of the keywords in your list (which should have been split in 700-line chunks), you want to go through them. There is no easy way of doing this, but the first I recommend doing is removing what is obviously unusable from your lists.
After that, use your common sense to find the best candidates to target as your long term keywords. Note that there WILL BE other affiliate sites on the SERPs for these. Any long term keyword worth pursuing is already known to affiliates. These will include a lot of “best” and “reviews” keywords – doesn’t mean they’ll be bad keywords to target long-term, it just means that you won’t magically appear in SERPs for them right away, which you should expect.
As for your short-term, product-review-type keywords, I tried but couldn’t really come up with a super specific set of rules to follow. However, here are a few things you should and shouldn’t do:
- Look beyond page 1 of the SERPs to get rid of “False Positives”
**removed**
- Look for low Page Authorities
- Check some of the SERP results manually
- Don’t spend too much time on Links, focus on content more
- Look at the Trends of a keyword
**removed**
A few other things worth mentioning
Further Investigation and Keyword Trends
After you’re done manually looking through the SERPs, you should do your own detailed analysis, especially for your long-term keywords. Here are a couple of keywords I found recently – one was for a client, while the other one was for one of my affiliate sites:
**removed**
Now, for both of these keywords it’s important to notice that the searches in the last couple of months are SIGNIFICANTLY higher than the average monthly searches – had I picked different filters, I never would have found these.
However, can you tell which of these keywords would be better one to target? No way you could without further research. So, after looking into these, I found that the first keyword was a $700 product that recently came out. Commission for this would be quite decent, and competition was quite low since the competition didn’t seem to be catching up just yet – surely something my client would love to get.
The second keywords, however – even though it had higher monthly searches and even lower competitiveness, was one that people were only searching for because they were seeing a very particular Facebook ad for it. I checked Google Trends, and as I suspected, the person had already stopped running ads for this product and monthly searches were now close to none. However, KWFinder hadn’t updated the monthly searches after November 2017.
Another thing you should do when further investigating a keyword is finding long tail and LSI keywords (can use LSIGraph.com again here) to target in your article. You will often find hundreds of monthly searches of keywords than can bring extra traffic if you at least mention them in your content – you don’t even necessarily have to be targeting all of them properly. Not only can these bring more visitors, they can also help rank better for the initial keyword , since Google lately is really placing an accent on semantic search.
Alternative keyword research techniques/tools you might want to look into
Here are some other ways you can make your life easier when searching for keywords:
- Filtering for CPC
- Using Ahref's Keyword Difficulty Scores
- Moz’s Keyword Explorer Tool
-The graphs they show for each keyword make it visually easy for me to make a quick decision on whether that’s a good long-term keyword or not
-Their Organic CTR and Priority scores make it easy to find potentially profitable keywords to targets
-They have a “Keyword Suggestions” option, which, much like SEMRush, helps you find related keywords you can be targeting
-Moz Lists make it easy to keep the keywords you’re targeting organized
- Using KeySearch
**removed**
- Consider using Custom Tools
The newbie FAQ
This isn’t something I would normally do, but it’s funny to see newbies post the same questions over and over again. So, to answer a few of the questions being frequently asked:
- “Is xxxxxx a good keyword?”
- “How many links will I need to outrank everyone or to get to page 1”
- “X tool shows Y competitiveness score, should I target this keyword?”
- “Can I outrank Amazon/Ebay/Walmart/Etsy/Target/Another-Large-Ecom-Site”
Anyway, it’s day two and 12+ hours of writing this and I’m about 5100 words in. I tried to put this together so it makes as much sense as possible and if anything is unclear, please ask. There’s definitely more to say about keyword research, but let’s save a little more something for later
Last edited by a moderator: