# Allow search engines to crawl all content except archives User-agent: * Disallow: /WEBSITE/