Special case for spatial direct MV predictor being 0.