Right now i am working on website which is totally flash website.I have done all things to crawl and index it in Google but I failed.
Website created through MotoCms which which is very difficult to use.
Website has robots.txt file created but i robots.txt is also badly created and i am not...
User-agent: *
Disallow: /*?
Disallow: *.swf$
Disallow: *.js$
Disallow: /admin/
Disallow: /xml/
In one of the site i have seen this kind of robots.txt file. can some one tell me what does this mean. As i have less knowledge in Robots.txt so to get more knowledge about this i want to know.
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.