avcodec/vc1: fix overlap smoothing filter for P frames
authorJerome Borsboom <jerome.borsboom@carpalis.nl>
Wed, 30 May 2018 11:53:48 +0000 (13:53 +0200)
committerCarl Eugen Hoyos <ceffmpeg@gmail.com>
Sat, 16 Jun 2018 17:15:07 +0000 (19:15 +0200)
commita43cdd769301af21d062d002ec1487908e44474a
tree4f9a3958bdfe9b4dc64b35d64c481fd9c04f141e
parent07d1c4ae3f45bda6085e55a16e8b79aa4fd0bde9
avcodec/vc1: fix overlap smoothing filter for P frames

The v_overlap_filter needs to run on the colocated block of the previous
macroblock. For the luma plane, the colocated block is located two blocks
on the left instead of one. In addition, the overlap filter needs to run
on the non-edge blocks of the first macroblock row and column.

Fixes ticket #7171.

Signed-off-by: Jerome Borsboom <jerome.borsboom@carpalis.nl>
libavcodec/vc1_loopfilter.c