Home › Forums › Other › Robots.txt or <meta name="robots"> ? › Re: Robots.txt or ?
June 17, 2009 at 12:18 pm
#59265
Vinnix
Member
The Robots.txt or meta Robots caches the site for SEO right?
It seems like it does that once in a while I am assuming based on traffic flow, my question is that can you cache it yourself without the search engine crawling for it?