User-agent: *
Disallow: /assets/
Disallow: /crons/
Disallow: /lib/
Disallow: /media/