Remove packet returning in ff_rm_parse_packet() if we're using the packet