• # December 12, 2011 at 4:22 am

    For each website, Media Temple has a site preview url. It looks something like this:

    My site is up and running but I’d like google to not crawl that site since I don’t want any canonical problems or anything. Is there any Media Temple user here who has found a solution to this problem?

    # December 12, 2011 at 4:38 am

    This reply has been reported for inappropriate content.

    Would have been quicker to ask them ;-)!/mediatemple/status/146161602700378112

    # December 12, 2011 at 5:31 am

    Thanks Mark! I guess they do some kind of minor blocking which is why Google only indexes it if you make it public.

    I did actually ask them and they gave a similar robots.txt answer. I’m not really sure how to specifically block with the robots.txt – as far as I know you can block files and folders, not urls.

    But it seems it won’t be a problem since no one else has really complained about this before.

    Thanks again

    # December 12, 2011 at 6:28 am

    This reply has been reported for inappropriate content.

    The basic rule of search engines is that the only way a page can be indexed is if you either submitted it to them to index, or they could crawl to the site from another URL.

    If there are no links to the site on the internet then the site should not be indexed.

    These are no-follow links on CSS Tricks so they should not be indexed (yes spammers, you are wasting your time :-) )

    # December 15, 2011 at 5:02 pm

    You can also request a URL removal via Google Webmaster:

Viewing 5 posts - 1 through 5 (of 5 total)

You must be logged in to reply to this topic.