The link in @1lann’s post to the http.proxy documentation is pretty comprehensive, particularly the examples section:
https://caddyserver.com/docs/proxy#examples
These go in your Caddyfile, with some adaptation to suit your backend hosts.
As for testing, I’d recommend checking the access logs of your backends - Caddy’s proxy will show up as standard client requests.