Ensure that our total reference frame count does not exceed the SPS