vf_scale_vaapi: Respect driver quirks around buffer destruction