libllama
LLM inference in C/C++
LLM inference in C/C++
To install this package, run one of the following:
Inference of Meta's LLaMA model (and others) in pure C/C++
Summary
LLM inference in C/C++
Last Updated
Jun 2, 2026 at 12:38
License
MIT
Supported Platforms
Unsupported Platforms
GitHub Repository
https://github.com/ggml-org/llama.cppDocumentation
https://github.com/ggml-org/llama.cpp