Google search console server error (5xx)

How to fix this issue? I don't want this to be indexed by google.

Disable that directory from getting crawled using something like

That should do it. The robots are not supposed to crawl those files.

Gogol said:

Disable that directory from getting crawled using something like

Code:

User-agent: *
Disallow: /wp-includes

That should do it. The robots are not supposed to crawl those files.

Click to expand...

this is the best solution to this problem, at First I thought it’s a server issue but now I know how to fix this issue if it ever pops up on my client site

Mr Positive said:

this is the best solution to this problem, at First I thought it’s a server issue but ne I kowtow how to fix this issue if it ever pops up on my client site

Click to expand...

It's a good practice to disallow wp-content and wp-includes even if you are not getting any errors.

Mr Positive said:

but ne I kowtow

Click to expand...

Where did you learn this secret language?

mrtruehybrid said:

Where did you learn this secret language?

Click to expand...

Probably android keyboard. It makes dumb mistakes. I just switched the auto correction off to fix this.

Gogol said:

Disable that directory from getting crawled using something like

Code:

User-agent: *
Disallow: /wp-includes

That should do it. The robots are not supposed to crawl those files.

Click to expand...

User-Agent: *
Disallow: /cgi-bin
Disallow: /wp-
Disallow: /wp-includes
Disallow: /wp-admin/
Disallow: /wp-content/plugins
Disallow: /?s=
Disallow: *&s=
Disallow: /search
Disallow: /author/
Disallow: *?attachment_id=
Disallow: */feed
Disallow: */rss
Disallow: */embed
Allow: /wp-content/uploads/
Allow: /wp-content/themes/
Allow: /*/*.js
Allow: /*/*.css
Allow: /wp-*.png
Allow: /wp-*.jpg
Allow: /wp-*.jpeg
Allow: /wp-*.gif
Allow: /wp-*.svg
Allow: /wp-*.pdf

does this do it? I just downloaded a wordpress robots.txt plugin

wfjcc said:

User-Agent: *
Disallow: /cgi-bin
Disallow: /wp-
Disallow: /wp-includes
Disallow: /wp-admin/
Disallow: /wp-content/plugins
Disallow: /?s=
Disallow: *&s=
Disallow: /search
Disallow: /author/
Disallow: *?attachment_id=
Disallow: */feed
Disallow: */rss
Disallow: */embed
Allow: /wp-content/uploads/
Allow: /wp-content/themes/
Allow: /*/*.js
Allow: /*/*.css
Allow: /wp-*.png
Allow: /wp-*.jpg
Allow: /wp-*.jpeg
Allow: /wp-*.gif
Allow: /wp-*.svg
Allow: /wp-*.pdf

does this do it? I just downloaded a wordpress robots.txt plugin

Click to expand...

yup that looks pretty good. In-fact, I will steal the list too.