User-agent: * Disallow: *.txt$ Disallow: *.rar$ Disallow: *.zip$ Disallow: /download/secure/* Disallow: /download/intranet/* Disallow: /download/college/* Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /explorer/* Disallow: /log/* Disallow: /htm/*