Hi, while analyzing the log files (Kibana+Excel) of my website, I noticed that the Google Desktop Bot crawls most often "monster URLs" that look like this: /news.xml/16851/[category name]. html
I can't explain to myself how such URLs are created and why the bot looks at them so often. The mobile...
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.