User-agent: * Disallow: /logs/ Disallow: /bkup/ Disallow: /docs/ Disallow: /admin/