avfilter/vf_vectorscope: 9 & 10 bit depth support