# exclude some access-controlled areas User-agent: * Disallow: /stats Disallow: /spss Disallow: /randomredirect Disallow: /aspnet_client Disallow: /backup_linux Disallow: /test