Could be a bug of some kind in recent versions… The cache plugin is developed by @nicolasazrak:
If you could narrow your Caddyfile down to the simplest possible version that breaks with cache present (does it happen just with cache and any rewrite?) and post an issue to that Github repository (possibly linking to this forum thread), he should be better able than I to help sort it out.