net: phy: marvell: Only configure RGMII delays when using RGMII