Use left_mb_xy from fill_caches instead of recalculating it.