You’ll need to remove the server inside of a handle_errors block as well. When a handler encounters an error (in this case, file not found), then it takes a different execution path that avoids other handlers, including response header modification.
I must ask though, what do you hope to gain from obfuscating that header? It has no security benefit to do so.