Then you should use sudo systemctl caddy reload if you’re running Caddy as a service (which the PPA automatically sets up)
sudo systemctl caddy reload