I have multilingual website running on plugins. Having subdirectories to define different languages according to the destination. There are total 4 subdirectories with the main website and all are having seperate robots.txt file with seperate codes in them. See the screenshots attached. One is for genderselection dot com / robots . txt (screenshot 1) and other is for genderselection dot com / es / robots . txt (screenshot 2)
Does it makes any difference or I should ignore this as i have read it that robots.txt file is not get crawled for subdirectoires. Please help!
I have set the robots file for main website and hoping to see the same code for all subdirectories. Is it possible?
Does it makes any difference or I should ignore this as i have read it that robots.txt file is not get crawled for subdirectoires. Please help!
I have set the robots file for main website and hoping to see the same code for all subdirectories. Is it possible?