avcodec/nvenc: fix lossless tuning logic