drm/imx: imx-ldb: remove unnecessary double disable check