Caddy’s try_files works slightly differently than Nginx’s. Caddy’s requires the file to exist on disk for the last entry (e.g. index.php) but nginx allows it to not exist on disk and rewrites to that anyway.
Caddy needs to see the PHP files to know how to rewrite to them, and for file_server to work to serve your static assets.