User-agent: * allow: / # Directories Disallow: /en/ Disallow: /profile/ # Files Disallow: /README.txt # Paths (clean URLs) Disallow: /admin/ Disallow: /cp/ Disallow: /search Disallow: /en/search Disallow: /register Disallow: /password/ Disallow: /login Disallow: /logout