Caddy Crowdsec issue

If I manually ban myself, some sites show the Crowdsec Ban page, but others show a HTTP 403 only. Really struggling to understand why, I have tried so many variations of the config now. Help please

I use order crowdsec first in the global block

(private-ips) {
        client_ip 192.168.1.0/24 192.168.2.0/24 192.168.39.3/32 192.168.100.0/24
}
(private-app) {
        @private {
                import private-ips
        }
        handle /caddy-security/* {
                authenticate with myportal
        }
        handle @private {
                crowdsec
                authorize with mypolicy
                reverse_proxy {args[0]}
        }
        handle {
                respond "Access denied" 403
        }
}
jellyseerr.domain.com {
        crowdsec
        handle {
                reverse_proxy 192.168.40.131:5055
        }
}
radarr.domain.com {
        import private-app 192.168.40.158:7878
}

Some reason jellyseer or anything not handled by (private-app) shows a 403, and if not shows the Crowdsec ban page…

I have tried putting crowdsec in the handle, using route, using nothing. I am totally stumped on why this is behaving as such. Then during testing, sometimes the working ban page on radarr does the same 403. Until I restart caddy…