Google low crawl rate

Sounds like Google sees the site as low quality, not a crawl budget issue. Disallowing pages won't fix that. Focus on improving content, internal linking, and get a few quality backlinks that should help bring crawl activity back.
 
Hi friends,

I got a website, which is hated by google. Most of my pages got deindexed and the crawl rate was reduced massively.

I thought maybe I could give my important pages more crawl budget by putting thousands of pages to disallow in robots.txt.
My website offers ebooks, which means one book can have hundreds of pages (chapters). I set robots.txt to disallow all chapter pages but the first 3 of every book.

However, my pages still don't get indexed anymore and the crawl rate is very low (6-17), while Bing and Yandex are crawling 300 pages each.

Does anyone have an idea how to solve this?
You should contact support
 
Hey man, reducing access via robots isn't always the solution if Google already sees your site negatively. It sounds like there might be a deeper issue with the overall quality or purpose of the content. You really need to focus on making your main pages incredibly unique and valuable to actual users. Think about what truly makes your site stand out and if those chapter pages are truly adding distinct value. Sometimes too many similar pages can be a problem. Check if you've received any previous notifications about your site.
 
There might be many reasons for this.
Either you have spammy backlinks, which flag Google. Next, your content is not that valuable and is available in mass.
3rd Check your website issues and try to fix them
 
Back
Top