Use curl -v to make the requests, to see exactly what’s happening. Caddy isn’t configured to make any redirects so that must be happening in your react app.
curl -v
You likely have some base path configuration you need to set before building.
Some reading about this sort of problem: