avformat/utils: Check rfps_duration_sum for overflow