# llama.cpp

> Run language and vision-language models across local and cloud hardware.

llama.cpp helps users run language and vision-language models across local and cloud hardware. The product supports c and C++ inference engine and model server and command-line tools. Starting points include deploy a local model and compare inference performance on available hardware. Check the documentation, license, supported models, hardware requirements, and any separate API or hosting costs. Test on a small representative project before integrating it into an existing system.

## Quick facts

- Categories: LLM
- Official site: https://github.com/ggml-org/llama.cpp
- Last checked: 2026-09-26

## Key features

- C and C++ inference engine
- Model server and command-line tools

## Use cases

- Deploy a local model
- Compare inference performance on available hardware

## Links

- Nextool.ai page: https://nextool.ai/tools/llama-cpp/
- Alternatives: https://nextool.ai/alternatives/llama-cpp/

Source: Nextool.ai (https://nextool.ai/tools/llama-cpp/). Pricing and features change; confirm on the provider's site before relying on them.