Hello,
Tonight my production instance went down, for the first time in 13 months (since I use Caddy daily in fact), can you help me understand why?
Here is the logs:
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: panic: runtime error: invalid memory address or nil pointer dereference
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: [signal SIGSEGV: segmentation violation code=0x1 addr=0x20 pc=0x475231]
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: goroutine 896670 [running]:
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: bufio.(*Writer).Available(...)
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: #011/usr/local/go/src/bufio/bufio.go:590
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: bufio.(*Writer).WriteString(0x0, 0xb9345b, 0x19, 0xc420424c30, 0x9, 0xb8d81d)
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: #011/usr/local/go/src/bufio/bufio.go:671 +0x71
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: net/http.(*expectContinueReader).Read(0xc4203e9800, 0xc4207ca000, 0x1000, 0x1000, 0xc420e768c8, 0xb33220, 0xc420cc2800)
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: #011/usr/local/go/src/net/http/server.go:867 +0x15e
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: io.(*teeReader).Read(0xc4203e98c0, 0xc4207ca000, 0x1000, 0x1000, 0xc420867d00, 0x3, 0x3)
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: #011/usr/local/go/src/io/io.go:533 +0x55
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: net/http.transferBodyReader.Read(0xc4202ab220, 0xc4207ca000, 0x1000, 0x1000, 0xadcac0, 0xc42001c001, 0x0)
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: #011/usr/local/go/src/net/http/transfer.go:60 +0x56
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: io.(*LimitedReader).Read(0xc4203b8320, 0xc4207ca000, 0x1000, 0x1000, 0x0, 0xc420867c00, 0x3)
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: #011/usr/local/go/src/io/io.go:446 +0x63
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: bufio.(*Writer).ReadFrom(0xc4214a4fc0, 0xc10b40, 0xc4203b8320, 0x7f25c146a100, 0xc4214a4fc0, 0xc420fbd401)
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: #011/usr/local/go/src/bufio/bufio.go:703 +0xcd
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: io.copyBuffer(0xc0ff20, 0xc4214a4fc0, 0xc10b40, 0xc4203b8320, 0x0, 0x0, 0x0, 0xae6f20, 0xc420d07001, 0xc4203b8320)
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: #011/usr/local/go/src/io/io.go:386 +0x31a
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: io.Copy(0xc0ff20, 0xc4214a4fc0, 0xc10b40, 0xc4203b8320, 0xc420867c2f, 0x0, 0x0)
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: #011/usr/local/go/src/io/io.go:362 +0x5a
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: net/http.(*transferWriter).WriteBody(0xc4202ab220, 0xc0ff20, 0xc4214a4fc0, 0x2, 0x2)
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: #011/usr/local/go/src/net/http/transfer.go:337 +0x5fa
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: net/http.(*Request).write(0xc420751d00, 0xc0ff20, 0xc4214a4fc0, 0x0, 0xc420d62f90, 0xc4203e9980, 0x0, 0x0)
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: #011/usr/local/go/src/net/http/request.go:622 +0x6b2
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: net/http.(*persistConn).writeLoop(0xc420235200)
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: #011/usr/local/go/src/net/http/transport.go:1825 +0x1ea
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: created by net/http.(*Transport).dialConn
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 caddy[9702]: #011/usr/local/go/src/net/http/transport.go:1238 +0x97f
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 systemd[1]: caddy.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
Jun 4 00:38:36 ubuntu-32gb-nbg1-1 systemd[1]: caddy.service: Failed with result 'exit-code'.
FYI I activated telemetry yesterday evening, maybe it’s related?
Thanks in advance,