
research note
UniPool: A Globally Shared Expert Pool for Mixture-of-Experts
UniPool addresses a structural inefficiency in standard Mixture-of-Experts (MoE) transformers: the rigid convention that each transformer layer owns its own private set of expert FFNs, which forces…










