@francislavoie Could the suggestion proposed in this thread here Handle_errors not working - #2 by francislavoie be used here
Process check: Spreading the Caddy Word - #19 by Whitestrake? If so, it might lead to a solution that avoids the use of the expanded form of phph_fastcgi.