Check AVCodec.pix_fmts in avcodec_open2()