Googlebot attack my websites

I had crawl rate 6.000.000 pages per day but I bought SERVER that has 12 cores, 32GB RAM, 1GBs, SSD... No high response for any pages. Everything runs normally.
 
I had crawl rate 6.000.000 pages per day but I bought SERVER that has 12 cores, 32GB RAM, 1GBs, SSD... No high response for any pages. Everything runs normally.
Have you noticed traffic decreasing in March after increasing crawl rate? Or this crawl rate is usually for you?
 
I'm trying like shit to get Googlebot to do this to a site of mine and you're complaining?
True man, but, when you have server with 50 GB RAM and 10 Core cpu and this can't handle this massive flood of requests you will understand that isn't something normal.
 
True man, but, when you have server with 50 GB RAM and 10 Core cpu and this can't handle this massive flood of requests you will understand that isn't something normal.

Back when Google started, they would crawl as fast as they could and knock out servers everywhere. I made $ fixing that for clients.

It's awesome when it happens mate. It means Googlebot loves you.

All that pressure Googlebot had inside it, suddenly blown out all over your server which is now dripping in 100% pure crawl Googlejuice!!!! It's where SEO is born mate!!! That's how SEO is made! It's not always pretty but that's how SEO is born. Cheers! It's a boy!
 
Back
Top