User-Agent: * Allow: / #allow everything by default Disallow: /fileadmin/templates #then add restrictions Disallow: /typo3/ Disallow: /t3lib/ Disallow: /typo3conf/ Disallow: /typo3temp/ Disallow: /*?id=* User-agent: googlebot # Google specific settings Disallow: /*?tx_indexedsearch Sitemap: /?eID=dd_googlesitemap # finally add some sitemap