build: Explicitly disable external libraries when not explicitly enabled