User-agent: * Disallow: /public Disallow: /pub Disallow: /homepages/register.php Disallow: /cgi-bin Disallow: /cgi Disallow: /eforum Disallow: /forum Disallow: /pipermail Disallow: /docs/php-manual