User-agent: * 
Disallow: /cache/
Disallow: /cron/
Disallow: /css/
Disallow: /inc/
Disallow: /js/