irda: Fix a misalign access issue. (v2)