Dont calculate any surrounding MVs for temporal MBs