Geometry of the SDF: The Factor Zoo as Structured Ambiguity