Reply To: Canonical & robots meta tag

[I.m.learning]

I’m good on the canonical now; PHP is taking care of that for me.

When I started this website 2 months ago, I really had no clue what I was doing. Now I am spending the day making EXTREME changes. With that comes more research that is truly confusing me.

As far as the robots, my concern is the files my host provides as defaults:

bin, etc, logs, mail, ssl, tmp, & access-logs

I truly don’t know what [ALL] these files are for and don’t use them for my own content. But, I don’t know if I should disallow them. I don’t even know if robots access these files.

As I said, my content is limited, but when I start adding DBs and cookies, this may be important.

I also have public_ftp and public_html…seems obvious NOT to block these ones.