~caddy is the same as /var/lib/caddy, because the HOME of the caddy user is /var/lib/caddy. See the script in the .deb:
Basically ~<user> is a shortcut for giving you the HOME of a particular user. ~ on its own is the HOME of the current user.
You can test it by running echo ~caddy