avfilter/vf_vectorscope: less aggressive memory allocation