I wrote some examples of how to run socket-activated Caddy with rootless Podman here:
A cool thing is that X-Forwarded-For is now supported when running Caddy with rootless Podman (using network driver Pasta). Caddy can act as a reverse proxy for a custom network (i.e. a network that was created with podman network create mynet or with a quadlet).