When I used to run Caddy by itself I would just open up byobu and run Caddy directly. Worked perfectly for me.
byobu