Entity
TensorRT-LLM
NVIDIA's TensorRT-LLM, an SDK for optimizing and deploying LLMs, supporting BF16 inference for DeepSeek-V3.
术语属性
- Supported Precision：BF16
Entity
NVIDIA's TensorRT-LLM, an SDK for optimizing and deploying LLMs, supporting BF16 inference for DeepSeek-V3.