User-agent: HCrwl
Allow: /crwl/
Allow: /files/

User-agent: *
Disallow: /