Can I use "DNS alias mode" to issue a cert with caddy?

Yep! This is called ACME challenge delegation. The DuckDNS plugin has built-in support for it: