User-Agent: *
Allow: /
Disallow: /bin/
Disallow: /admin/
Disallow: /cms/
Disallow: /app_data/
Disallow: /common/
Disallow: /core/