Your first route matches all requests, so once the file server has finished its job the request has already been handled. The more specific route should usually go first.
This wiki article will help; it is about the Caddyfile but will help you understand how to compose handlers in general: Composing in the Caddyfile