Reply To: What is robots.txt?

[nixnerd]

…and then, the robots decide whether or not to listen to you.

Yeah… this is true. I mean, for Ess Eee Oh purposes, it generally works. Google is good about it. That being said, there’s no international bot governing body that makes them properly access your site. They’re definitely by no means a security measure.