Entity
A toolkit for deploying and serving large language models, supporting native FP8 inference for DeepSeek-V3.