Eliminate support for direct_8x8_inference=0