Store pointers in a less messy way in SWSContext.