swscale: fix overflow in 16-bit vertical scaling.
authorRonald S. Bultje <rsbultje@gmail.com>
Fri, 8 Jul 2011 21:57:07 +0000 (14:57 -0700)
committerRonald S. Bultje <rsbultje@gmail.com>
Fri, 8 Jul 2011 22:15:30 +0000 (15:15 -0700)
commit7d7bacf0f1f43f5cc112977fc3b8438e3e4a4a9b
tree522858daab38897c92fde6edd506c883177c8e8d
parentbf2cba453244a74331238a472fe0e309f116f4d9
swscale: fix overflow in 16-bit vertical scaling.

We operated on 31-bits, but with e.g. lanczos scaling, values can
add up to beyond 0x80000000, thus leading to output of zeroes. Drop
one bit of precision fixes this.
libswscale/swscale.c
tests/ref/lavfi/pixdesc
tests/ref/lavfi/pixfmts_copy
tests/ref/lavfi/pixfmts_crop
tests/ref/lavfi/pixfmts_hflip
tests/ref/lavfi/pixfmts_null
tests/ref/lavfi/pixfmts_scale
tests/ref/lavfi/pixfmts_vflip