net/mlx5e: Avoid dealing with vport representors if not being e-switch manager