---
id: "local-on-device-ai"
title: "llama.cpp"
creator: null
creator_url: null
creator_x: null
url: "https://github.com/ggml-org/llama.cpp"
level: "n/a"
level_max: "n/a"
category: "model-training"
subcategory: "training-infrastructure"
region: "unknown"
license: "unknown"
license_scope: "linked-resource"
access: "free"
models: []
source_date: null
date_added: "2026-10-18"
resource_kind: "entity"
verification_basis: "supplier-inventory-v2.3"
access_evidence: "Supplier-approved free inventory; not independently verified by this site."
domain_top: "Infrastructure, chips & efficiency"
domain_sub: "local/on-device"
last_verified: "2026-10-18"
---

[Model Training](/model-training/index.md)

# llama.cpp

Creator not supplied; see original source.

[Read the original →](https://github.com/ggml-org/llama.cpp)

llama.cpp GitHub repo: LLM inference in C/C++ for local and on-device hardware.

Level: [Not applicable (entity)](/levels/index.md)
Models: 
Category: [Model Training](/model-training/index.md)
Tags: [infrastructure-chips-efficiency](/tags/infrastructure-chips-efficiency/index.md), [local-on-device](/tags/local-on-device/index.md)
Source date: date not stated
Added: 2026-10-18
Last verified: 2026-10-18
Status: ok
Prerequisites: n/a (entity)
Subcategory: [training infrastructure](/model-training/training-infrastructure/index.md)
Region: unknown
Original language: en
Access: free
Resource reuse: unknown: Not supplied; no reuse grant asserted. [Facet definitions](/about/index.md#facets)
Verification basis: Supplier-reported live check; no independent HTTP verification by this site.
Access evidence: Supplier-approved free inventory; not independently verified by this site.
Source domain: Infrastructure, chips & efficiency
Source subdomain: local/on-device
Supplier region label: Bulgaria

Summary in our own words. Rights remain with the original creator. [Credit and correction policy](/about/index.md#credit-policy).

[Plain-text Markdown copy](/model-training/training-infrastructure/local-on-device-ai/index.md)