That’s not a problem with your certs, that’s a problem with your proxy upstream address.
Are you sure that IP address reaches the service you expect? You’re using :8443
, is that upstream expecting HTTPS traffic? If so, see the docs: reverse_proxy (Caddyfile directive) — Caddy Documentation