That’s because the Caddy service uses PrivateTmp which isolates /tmp for the service, replaced with something like /tmp/systemd-private-<some-hash>-caddy.service-<some-id>/tmp
Try putting your socket file somewhere else like /run which is usually where services put their socket files.