buffersrc: fix invalid read in uninit if the fifo hasn't been allocated