
AirLLM:4GB GPU上运行700亿参数大模型的开源框架
BLUF
AirLLM is an open-source framework that enables running 70B-parameter large language models on a single 4GB GPU through layer-wise offloading and memory optimization techniques, democratizing access to cutting-edge AI without traditional compression methods. (AirLLM是一个开源框架,通过分层卸载和内存优化技术,使700亿参数的大语言模型能够在单个4GB GPU上运行,无需传统压缩方法即可实现前沿AI的普及化访问。)AI大模型2026/1/25







