I worked around the issue by reinstalling caddy via curl https://getcaddy.com | bash -s personal, and followed instructions in here https://github.com/caddyserver/caddy/tree/master/dist/init/linux-systemd to setup service. This time the service went through that step without issues.
2 Likes