Entity
Parameter Activation
In MoE models, the subset of total parameters actually used during inference for a given input, determining computational cost
术语属性
- type：Efficiency metric
- measurement：Activated parameters
- impact：Computational cost
Entity
In MoE models, the subset of total parameters actually used during inference for a given input, determining computational cost