Remove useless things from the deblock side of fill_caches().