Have there already been commits lately that expose error handling to Caddyfile v2 lately? I also really like Caddy v2 to serve a custom 404 page just like v1 did with the errors directive:
errors {
404 404.html # Not Found
500 500.html # Internal Server Error
}