It’s a binary that you run.
wget -O caddy <download-link> chmod +x caddy ./caddy
The download page should note that.