Do you control the domains?
If so, just add them to your Caddy config.
If not, use on-demand TLS. There’s a guide for this here: