llama.cpp
LLM inference in C/C++
Installation
To install this package, run one of the following:
Usage Tracking
0.0.3184
0.0.1661
2 / 8 versions selected
Downloads (Last 6 months): 0
Description
Inference of Meta's LLaMA model (and others) in pure C/C++
About
Summary
LLM inference in C/C++
Last Updated
Jul 11, 2024 at 16:33
License
MIT
Supported Platforms
linux-64
GitHub Repository
https://github.com/ggerganov/llama.cppDocumentation
https://github.com/ggerganov/llama.cpp