avcodec/jpeg2000dwt: Fix integer overflow in dwt_decode97_int()
authorMichael Niedermayer <michael@niedermayer.cc>
Mon, 26 Jun 2017 13:05:08 +0000 (15:05 +0200)
committerMichael Niedermayer <michael@niedermayer.cc>
Mon, 26 Jun 2017 14:06:25 +0000 (16:06 +0200)
Fixes: runtime error: signed integer overflow: -163654656 * 256 cannot be represented in type 'int'
Fixes: 2367/clusterfuzz-testcase-minimized-4648678897745920

Found-by: continuous fuzzing process https://github.com/google/oss-fuzz/tree/master/projects/ffmpeg
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
libavcodec/jpeg2000dwt.c

index 735ed0b..e4aa2e4 100644 (file)
@@ -488,7 +488,7 @@ static void dwt_decode97_int(DWTContext *s, int32_t *t)
     line += 5;
 
     for (i = 0; i < w * h; i++)
-        data[i] *= 1 << I_PRESHIFT;
+        data[i] *= 1LL << I_PRESHIFT;
 
     for (lev = 0; lev < s->ndeclevels; lev++) {
         int lh = s->linelen[lev][0],