evdev: Release eventual input device grabs when getting disconnected