The forums ran from 2008-2020 and are now closed and viewable here as an archive.

Home Forums Other Robots.txt or <meta name="robots"> ? Re: Robots.txt or ?


The Robots.txt or meta Robots caches the site for SEO right?
It seems like it does that once in a while I am assuming based on traffic flow, my question is that can you cache it yourself without the search engine crawling for it?