Robots.txt problem...

  • Thread starter Thread starter Deleted member 834202
  • Start date Start date
D

Deleted member 834202

Guest
Hi,

I downloaded a plugin "Virtual robots.txt" for Wordpress. The plugin change my robots.txt but now I can't edit it. So I remove it. But my robot is always the same. I tried to download some others plugins but it override everything. When I upload a physical robot.txt on my root it override too... I'm on the problem since 5 hours, I'm tired. If my problem is resolve, I don't download plugins anymore... Everytime I've got problems.

Someone can help me please ?

Code: 
# This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-includes/
Allow: /wp-includes/js/
Allow: /wp-includes/images/
Disallow: /trackback/
Disallow: /wp-login.php
Disallow: /wp-register.php
 
Advertise on BHW
Do you have any other plugin that might be caching the robots.txt file?
 
vistatech said:
Do you have any other plugin that might be caching the robots.txt file?
Click to expand...
I don't think... I disabled all my plugins for a test and nothing change.
 
Try to edit your robot.txt file. You can do it through Yoast seo plugins. Google for more help.
 
Kidax said:
Easyname.com, it's an issue with my host ? I use Cloudflare too.
Click to expand...

You'd try contacting your host and tell them about the problem. Maybe they're automatically caching your content. Or, as @nahid133 suggested try using Yoast's SEO Plugin, if you have it installed to edit the file before you contact your host.
 
nahid133 said:
Try to edit your robot.txt file. You can do it through Yoast seo plugins. Google for more help.
Click to expand...
I tried... A lot... There's no robots.txt from "Virtual robots.txt" plugin...
 
vistatech said:
You'd try contacting your host and tell them about the problem. Maybe they're automatically caching your content. Or, as @nahid133 suggested try using Yoast's SEO Plugin, if you have it installed to edit the file before you contact your host.
Click to expand...
I had just created my robots.txt. Do you think it's possible to caching instantly ?
 
Forget "Virtual robots.txt" plugin... as u already uninstalled it . try to find your robot.txt file
 
Guys thank you... That was cache... I'm going on Cloudflare, I make a purge and my robots.txt have changed !!! Thank you very much. I was desperate.
 
AstTrailerParkSupervisor said:
Just curious, wouldn't it be easier to just manually edit the robots.txt and upload it without using a plugin to do so?
Click to expand...
Yes totally easier. But I couldn't remember that was so easy.... It's been a long time since I've made a website.
 
Kidax said:
Guys thank you... That was cache... I'm going on Cloudflare, I make a purge and my robots.txt have changed !!! Thank you very much. I was desperate.
Click to expand...

Exactly. Next time when you make a change in your robot.txt or even css file, just remember to purge the cache in CloudFlare. Once I made some changes to my CSS file and it was still showing the old one. Took me few hours to realize that it was a cache problem at CF.
 
AstTrailerParkSupervisor said:
Ok cool, I'm no genius when it comes to webmastery either, just wanted to see if I was missing out on something lol
Click to expand...
Haha no, you were right! But when you start to download a plugin, you think you need an other plugin for everything lol

umerjutt00 said:
Exactly. Next time when you make a change in your robot.txt or even css file, just remember to purge the cache in CloudFlare. Once I made some changes to my CSS file and it was still showing the old one. Took me few hours to realize that it was a cache problem at CF.
Click to expand...
Next time it will be the first thing I will think... I searched everywhere and I was so tired. That was exhausting! But it's ok, all my mistakes learn me to search and ask for help. I'm not familiar with that.
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top