Your Transformer Is Secretly Elastic
A retraining-free method is proposed to adapt transformer models dynamically to varying hardware constraints and query workloads.
A retraining-free method is proposed to adapt transformer models dynamically to varying hardware constraints and query workloads.