Building a Better Search Engine With AI — Looking for Advice

I’m a software engineer, and lately I’ve been thinking about building my own search engine and experimenting with different approaches.
With AI improving so quickly, search engines are becoming much smarter at understanding intent, ranking results, and answering complex questions.
I’d like to combine traditional search techniques with AI to see how far I can push speed, relevance, and result quality.
I’m still in the research and experimentation stage, so I’d really appreciate advice from anyone who has worked with search engines, crawlers, indexing, ranking, or AI-powered search.

What technologies or experiments would you recommend starting with?

I think in the search engine Index is very important section for tradition or AI, BM25 + Embeddings is very useful... nowadays most search engine is to combinate tradition + AI. so can you tell me your idea???

I think it'd be tough to compete with Google, Bing, and the other search engines on that front – they're building the same kind of product, except they already have terabytes of data and billions in funding behind them.