avfilter/vf_scale_cuda: Fix incorrect scaling of > 8bit content