See GitHub - lucaslorentz/caddy-docker-proxy: Caddy as a reverse proxy for Docker, you can set global options by adding a label to your Caddy container itself.
The CDP docs also explain how you can set up a base Caddyfile if you prefer, you need to set an env var for it to get loaded.