Skip to content

llama.cpp

C/C++ inference for GGUF models. The runtime most local tools sit on.

open sourceUsed in 3 records

Built with it

3

Used alongside