avidec: Do not special case palette on big-endian