Entity
TRT-LLM
NVIDIA's TensorRT-LLM library for optimizing and deploying large language models.
术语属性
- Vendor：NVIDIA
- Purpose：LLM optimization and quantization
- Quantization Methods：INT8, symmetric
Entity
NVIDIA's TensorRT-LLM library for optimizing and deploying large language models.