avutil/libm: fix isnan compatibility hack
authorGanesh Ajjanagadde <gajjanagadde@gmail.com>
Wed, 25 Nov 2015 02:29:35 +0000 (21:29 -0500)
committerGanesh Ajjanagadde <gajjanagadde@gmail.com>
Wed, 25 Nov 2015 02:33:13 +0000 (21:33 -0500)
commit29af74e4e36daa3aa3ebafede844412d8cfff32b
treea479d0f7a7dc93995caab721ea4fb20d4434f21e
parent4f99308ed36b0fc5c2bd2121ad350aa3d80b1275
avutil/libm: fix isnan compatibility hack

Commit 14ea4151d7c3c26500193f11ac661ed20c7c2b9c had a bug in that the
conversion of the uint64_t result to an int (the return signature) would
lead to implementation defined behavior, and in this case simply
returned 0 for NAN. A fix via AND'ing the result with 1 does the trick,
simply by ensuring a 0 or 1 return value.

Patch tested with FATE on x86-64, GNU/Linux by forcing the compatibility
code via an ifdef hack suggested by Michael.

Signed-off-by: Ganesh Ajjanagadde <gajjanagadde@gmail.com>
libavutil/libm.h