Entity
GPT (Generative Pre-trained Transformer)
A series of autoregressive language models pre-trained to predict the next token in a sequence, forming the basis for models like ChatGPT.
术语属性
- Model Type：Autoregressive language model
- Architecture：Transformer decoder
- Training Method：Pre-training on unlabeled text