LlamaLanguageModels

KO | EN

gitlite — search

#ios #privacy #machine-learning #typescript #agent #hacktoberfest #web #pytorch #electron #python

LlamaLanguageModels

(★ 9)

Foundation Models API for llama.cpp

File Explorer

ZIP Download

- - Main.swift
- - LlamaLanguageModel.swift
- - LlamaLanguageModelTests.swift
.gitignore
Package.swift
README.md

# Use via CDN

jsDelivr

jsDelivr serves any public GitHub repository as a CDN with zero setup. Pick a version and a file to get a ready-to-paste link and snippet.

Version

File

Link

Example

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

Foundation Models API for llama.cpp.

Leverages the `LanguageModel` and `LanguageModelExecutor` protocols introduced in WWDC 2026. Offers the same API for llama.cpp models downloaded from Hugging Face. Built on the experimental [LlamaKit](https://github.com/pcuenca/llamakit).

## Usage

```swift
import FoundationModels
import LlamaLanguageModels

let model = LlamaLanguageModel(
    modelIdentifier: "Qwen/Qwen2.5-0.5B-Instruct-GGUF:Q4_K_M"
)
let session = LanguageModelSession(model: model)
let response = try await session.respond(to: "Who are you?")
print(response.content)
```

## Example CLI: `fm_llama`

[`Sources/fm_llama/`](https://github.com/pcuenca/LlamaLanguageModels/blob/main/Sources/fm_llama/Main.swift) is a minimal REPL with streaming.

```bash
swift run fm_llama ggml-org/gemma-4-26B-A4B-it-GGUF:Q4_K_M "Respond in verse"
```

## Requirements

- Swift 6.4+
- macOS 27+ / iOS 27+ / Xcode 27.0 beta

## To Do

- [ ] Default model generation parameters
- [ ] Faithful token counts
- [ ] Tool calling
- [ ] Reasoning
- [ ] Constrained generation

LlamaLanguageModels

Owner Repos

File Explorer

# Use via CDN

Was this content helpful?

Recent Feedback

LlamaLanguageModels

Owner Repos

File Explorer

# Use via CDN

Was this content helpful?

Recent Feedback

Download README