avfilter/formats: Avoid reallocations for video in ff_all_formats()