rtpdec_vp9: Make sure to free the temp buffer on close