vsrc_buffer: Store allocated scale filter and free it later.