I had this issue before, the solution is to run caddy and php-fpm under the same user/group and make sure Caddy’s user/group can read the document root folder (chmod?).
Here’s the issue I opened in case you want to check it:
https://github.com/mholt/caddy/issues/190#issuecomment-130536608
Perhaps we should edit the wiki 