Hey guys, I have wordpress website with 500 posts and I have 900+ indexed page. I check with command site and see lot of ../wp-include, wp-includes/Requests, I tried to add this in my htaccess "Options -Indexes" but now I only have lot of 403 error in webmaster, how can I fix this problem? Why Google index this pages?
Why google index this folders?
- Thread starter jyciap11
- Start date
I didn't touch anything :/, I got many errors in webmaster without doing anything.Use robots.txt instead of .htaccess
Funny it should be disallowed by default.
Confess, you played with it didn't ya?
Add this:
Code:User-agent: * Disallow: /wp-include/
I read online that google don't like diallow wp-includes folder because can't access to JSS and CSS file, what do you think about this?
- Sep 8, 2015
- 5,603
- 5,430
This is what I do on all money sites:
Code:
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/plugins/They really don't need to see those files.
On the other hand..
Is it really jeopardizing your rankings? The fact that they index those folders?
What are those WMT errors?
I don't know if index "wp-includes" folder hurt my ranking, because I only see the errors in webmaster like this:
wp-includes/Requests/.. 403 error
wp-includes/theme.. 403 error
etc.
He indexed all folders into wp-includes
- Sep 8, 2015
- 5,603
- 5,430
That's very strange because 403 is Permission Denied. But since it's indexed it must be allowed, right?
Anyway... I wouldn't worry about it much.
I told you what I do with my sites and they rank good.
Yes, in fact if I click in the link I got "error 403 forbidden".
I will try the disallow, thank you
- Sep 8, 2015
- 5,603
- 5,430
You're welcome.
Just checked my WMT console for one site using that robots.txt file. No such errors.
deanerzseo
Newbie
- Jul 13, 2018
- 7
- 0
If you block wp-includes which loads javascripts etc, you will lose your rankings.
So, the best is leave 403 error and wait that google deindex it?
- Oct 11, 2013
- 524
- 423
Take it off of .htacccess and add robots.txt to your site root directory with
and what about js file and similar? I read that google can penalize you if you block access to it
- Oct 11, 2013
- 524
- 423
For robots.txt :
Allow (Only applicable for Googlebot): The command to tell Googlebot it can access a page or subfolder even though its parent page or subfolder may be disallowed.
Code:
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/plugins/
Allow: /*.js
Allow: /*.cssThat solves your js/css problem
Ok so, this is my new robots, what do you think?
Code:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-includes/
Allow: /wp-includes/*.js
Allow: /wp-includes/*.css
Disallow: /wp-content/plugins/- Oct 11, 2013
- 524
- 423