# This robot should be usered in CMS or Intranet. # Ban all robots spidering the domain. User-agent: * Disallow: /