FastEEP: Fast Elastic Scaling for Expert-Parallel MoE Serving
Researchers present an elastic scaling approach to optimize expert-parallel mixture-of-experts model serving under dynamic workloads.
Researchers present an elastic scaling approach to optimize expert-parallel mixture-of-experts model serving under dynamic workloads.