GEOZ

Entity

Multi-head Latent Attention (MLA)

An attention mechanism used in DeepSeek models for efficient processing of long sequences.

术语属性

  • ApplicationUsed in DeepSeek model architecture

相关文章