User-Agent: * Disallow: /admin/ Disallow: /awstats/ Disallow: /download/ Disallow: /error/ Disallow: /extras/ Disallow: /fonts/ Disallow: /images/ Disallow: /js/ Disallow: /logs/ Disallow: /pub/ Disallow: /tmp/ Disallow: /cgi-bin/