Regarding SSL errors, this might be the same issue detailed here: Intermittent SSL handshake errors - #2 by Tracy-P
Time will tell if this is actually a solution, but it seems restarting the Caddy service instead of using caddy reload
might solve the problem with my websites too.