User-agent: * Disallow: /admin/ Disallow: /err/ Disallow: /lib/ Disallow: /public/