Do not close an fd we know is -1