Alternatives and similar repositories for llama.cpp

Users that are interested in llama.cpp are comparing it to the libraries listed below

• StanfordSpezi / SpeziLLM
  Large Language Model (LLM) module for the Spezi Ecosystem
  ☆245Updated 2 weeks ago
• Dripfarm / SVDB
  Swift Vector Database. On-device, local vector database for building the next-generation of user experiences
  ☆194Updated last year
• guinmoon / llmfarm_core.swift
  Swift library to work with llama and other large language models.
  ☆264Updated 5 months ago
• srgtuszy / llama-cpp-swift
  Swift bindings for llama-cpp library
  ☆60Updated 7 months ago
• huggingface / swift-chat
  Mac app to demonstrate swift-transformers
  ☆564Updated 11 months ago
• alexrozanski / llama.swift
  Fork of llama.cpp, supporting Facebook's LLaMA model in Swift
  ☆181Updated 2 years ago
• CameLLM / CameLLM
  Run your favourite LLMs locally on macOS from Swift
  ☆81Updated 2 years ago
• eastriverlee / LLM.swift
  LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watch…
  ☆679Updated last week
• buhe / langchain-swift
  🚀 LangChain for Swift. Optimized for iOS, macOS, watchOS (part) and visionOS.(beta)
  ☆398Updated 4 months ago
• ZachNagengast / similarity-search-kit
  🔎 SimilaritySearchKit is a Swift package providing on-device text embeddings and semantic search functionality for iOS and macOS applica…
  ☆471Updated last year
• huggingface / swift-transformers
  Swift Package to implement a transformers-like API in Swift
  ☆1,025Updated last week
• replicate / replicate-swift
  Swift client for Replicate
  ☆181Updated 10 months ago
• kevinhermawan / OllamaKit
  Ollama client for Swift
  ☆314Updated 4 months ago
• huggingface / coreml-examples
  Swift Core ML Examples
  ☆227Updated 7 months ago
• jkrukowski / swift-embeddings
  Run embedding models locally in Swift using MLTensor.
  ☆97Updated last month
• rryam / VecturaKit
  Swift-based vector database for on-device RAG using MLTensor and MLX Embedders
  ☆102Updated last week
• preternatural-explore / mlx-swift-chat
  A multi-platform SwiftUI frontend for running local LLMs with Apple's MLX framework.
  ☆413Updated 8 months ago
• gsabran / mcp-swift-sdk
  ☆182Updated last month
• jamesrochabrun / SwiftAnthropic
  An open-source Swift package for interacting with Anthropic's public API.
  ☆192Updated last week
• ashvardanian / SwiftSemanticSearch
  Real-time on-device text-to-image and image-to-image Semantic Search with video stream camera capture using USearch & UForm AI Swift SDKs…
  ☆128Updated 7 months ago
• PreternaturalAI / AI
  The definitive, open-source Swift framework for interfacing with generative AI.
  ☆205Updated last month
• johnmai-dev / Jinja
  A minimalistic Swift implementation of the Jinja templating engine, specifically designed for parsing and rendering ML chat templates.
  ☆50Updated 2 weeks ago
• Recouse / EventSource
  Server-sent events in Swift
  ☆112Updated 2 weeks ago
• meta-llama / llama-stack-client-swift
  llama-stack-client-swift brings the inference and agents APIs of Llama Stack to iOS.
  ☆58Updated 3 months ago
• nate-parrott / openai-streaming-completions-swift
  generate streaming LLM completions using openai in swift
  ☆103Updated 2 years ago
• rudrankriyam / MLX-Outil
  Tool calling using MLX Swift across iOS, macOS, and visionOS platforms
  ☆99Updated 3 weeks ago
• huggingface / exporters
  Export Hugging Face models to Core ML and TensorFlow Lite
  ☆661Updated last year
• jkrukowski / SwiftFaiss
  Use Faiss in Swift
  ☆44Updated last year
• loopwork / ollama-swift
  A Swift client library for interacting with Ollama. Supports structured outputs, tool use, and vision models.
  ☆410Updated 3 weeks ago
• StreamUI / StreamUI.swift
  🎥 〜StreamUI: Make videos with SwiftUI (and even stream them to Youtube, Twitch, etc)
  ☆244Updated last year