[Journey] Creating the best Free Keyword Research Tool

Welcome to my journey to create the best Free Keyword Research Tool (in case you didn't read the thread title already)

So I started scraping everything Google gave me and I now have 565 millions keywords and growing 9000 each minutes, i also started to scrape the google serps results to get even more data and i'm still working on it as i still didn't find a way for it to be efficient at scale without exploding costs.

So why its the best : because its unlimited, you can set filters, and there is precise search volume and cpc (google ads planner data)

Everything is totally Free and unlimited : theseolabs.com



19 June 2024 stats :
Keywords : 559 millions
Google Serp : 725 000
Related Keywords : 5 millions
People Also Ask : 2.5 millions

22 June 2024 stats :
Keywords : 565 millions
Google Serp : 842 000
Related Keywords : 6.1 millions
People Also Ask : 3 millions

Roadmap :
- Make a search for only questions keywords
- Make the serp data accessible for each
- Make new tools like bulk volume for 1000 keywords
- Make the searches faster (its slow for common words, like if you type "best" it will take like 2 minutes to search the whole database, if you type "blackhatworld" or "lebron james" its 2 seconds average)

If you have any questions or suggestions, don't hesitate.

Insane! Thanks for the contribution, I'll give this a bookmark and have a little play around with it...

it isn't working I typed a few keywords ?

BxHxW said:

Insane! Thanks for the contribution, I'll give this a bookmark and have a little play around with it...

Click to expand...

Dont hesitate to give me your impression and suggestions

howw said:

it isn't working I typed a few keywords ?

Click to expand...

What keyword did you type ? i tested with "seo tools" and "nepal trek" and got results

PHPspecialist said:

how you plan to monetize this ?

Click to expand...

I dont know if i'm allowed to answer this questions without getting this thread deleted and me banned since its prohibited to talk about sales and monetization outside the marketplace, but search photopea and lichess monetization, it will be ads (so i'm not selling anything dont ban me or my post pls mods thanks), it will be the same

New :
- The question tool is out and its always 100% free and unlimited : https://www.theseolabs.com/free-questions-keyword-tool-with-volume/

thefrenchvangogh said:

What keyword did you type ? i tested with "seo tools" and "nepal trek" and got results

Click to expand...

Some random famous cartoon character names

thefrenchvangogh said:

scrape the google serps results to get even more data and i'm still working on it as i still didn't find a way for it to be efficient at scale without exploding costs

Click to expand...

Hold on what do you mean sky rocketing costs, are you hosting it wtf.

Ah juicy add revenue from us, alright I'll bite

Alright did nothing. Best of luck

Thanks I just bookmarked this as keywordshitter no longer is up, I would also suggest changing the default website logo from the wordpress logo so it looks more legit.

24 June 2024 stats :
Keywords : 584 millions
Google Serp : 980 000
Related Keywords : 7.1 millions
People Also Ask : 3.5 millions

New Tool :
Keyword Shitter with Search Volume : https://www.theseolabs.com/keyword-shitter-with-search-volume-for-free/ (enter a keyword, and it will do like keyword shitter but faster and will give you a csv/excel with cpc and search volume data)

+Fixed a bug where certain queries with common words like "the" / "or" etc... where not returning anything

howw said:

Some random famous cartoon character names

Click to expand...

Can you DM me the keywords if you dont have results still ? You can use the free tool keyword shitter as it will scrape live your base keyword to google and not rely on my database

Gants-P said:

Hold on what do you mean sky rocketing costs, are you hosting it wtf.

Ah juicy add revenue from us, alright I'll bite

Alright did nothing. Best of luck

Click to expand...

Yes i'm scraping and hosting all of it myself, the 584 millions keywords are on a mysql server.
What do you mean by did nothing ?

M0ney33Wav3 said:

Thanks I just bookmarked this as keywordshitter no longer is up, I would also suggest changing the default website logo from the wordpress logo so it looks more legit.

Click to expand...

Changed thanks

Valuable share op.
Thank you!

If your keyword research tool is likely the best tool available, you are going to be rich. You can add paid versions later when it becomes popular.

Excellent. Can you add the difficulty level? In the future of course or will that be a paid version?

Love it!

One note: some keywords don't show results because they are missing spaces, which could be confusing to first-time users.

For example, I got no results when looking up "oak lawn" because all the search terms used "oaklawn" instead.

24 June 2024 stats :
Keywords : 593 millions
Google Serps : 1.09 millions ( surpassed 1 million)
Related Keywords : 8 millions
People Also Ask : 3.* millions

Changelog
- Fixed some bugs, 2 words letters make the search bug or doesnt return any results, because mysql is 3 letters minimum for each word, will be fixed with the better search engine later
- Excel export on the Keyword Shitter has been removed because CSV is better, i added the first 200 keywords as a table below the download button, to get more result check the file (can go up to 10k keywords with data in the file)

GenesisOne said:

Valuable share op.
Thank you!

Click to expand...

Thanks

onlinemarketer12 said:

If your keyword research tool is likely the best tool available, you are going to be rich. You can add paid versions later when it becomes popular.

Click to expand...

I'll try to make it the bes tool

Alf85 said:

Excellent. Can you add the difficulty level? In the future of course or will that be a paid version?

Click to expand...

Difficulty level is subjective, there are a lot of factors and ways to calculate it, and its a lot of the times false on ahrefs / semrush.
Its on my roadmap for later but there is a lot before i need to do, and the best difficulty number is you checking the serp manually with your eyes.

iantalty said:

Love it!

One note: some keywords don't show results because they are missing spaces, which could be confusing to first-time users.

For example, I got no results when looking up "oak lawn" because all the search terms used "oaklawn" instead.

Click to expand...

Thanks and yes MySQL FullText search is not a "smart" search engine like other solutions, and it doesn't include typo mistakes, very similar words etc...

I will switch to a better search engine later when the project get some traction, because i will need another server to install Elasticsearch / Meilisearch and its gonna ramp up my cost a lot

24 June 2024 stats :
Keywords : 604 millions
Google Serps : 1.16 millions ( surpassed 1 million)
Related Keywords : 8.5 millions
People Also Ask : 4.1 millions

Reverse engineered a lot of keyword apis for ecommerce sites and so on, new tools incoming

07 July 2024 stats :
Keywords : 655 millions
Google Serp : 2.88 millions
Related Keywords : 20 millions
People Also Ask : 9.5 millions

Got accepted in Adsense, time to finish the basics, add non intrusive ads and marketing
Working on a bulk keyword volume tool where you can paste 1000+ keywords and get the volume for every one of them

Nice work! I suggest adding a word count filter to help users find results for long-tail keywords.

Serpnest said:

Nice work! I suggest adding a word count filter to help users find results for long-tail keywords.

Click to expand...

Thanks, i added a long-tail option

thefrenchvangogh said:

Thanks, i added a long-tail option

Click to expand...

Awesome! Thank you!

12 July 2024 stats :
Keywords : 674 millions
Google Serp : 3.3 millions
Related Keywords : 24 millions
People Also Ask : 11 millions

- Corrected some bugs that resulted in getting 0 results for multiple words queries
- Added sorting by clicking in the table headers

New Tool : Bulk Search Volume & CPC
Past a list of up to 2000 keyword and you will get the search volume and cpc data for all of them

https://www.theseolabs.com/free-bulk-keyword-search-volume-tool/

New Tool : Amazon Keyword Research Tool

Available for theses countries :
United States
United Kingdom
Australia
Brazil
France
Germany
India
Italy
Mexico
Netherlands
Poland
Singapore
Spain
Sweden
Turkey