Alternatives and similar repositories for wllama

Users that are interested in wllama are comparing it to the libraries listed below

• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆269Updated 10 months ago
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆779Updated this week
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆702Updated 6 months ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆573Updated 4 months ago
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆308Updated 3 months ago
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆807Updated this week
• babycommando / entity-db
  EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly
  ☆177Updated last month
• lmstudio-ai / mlx-engine
  Apple MLX engine for LM Studio
  ☆618Updated last month
• tantaraio / voy
  🕸️🦀 A WASM vector similarity search written in Rust
  ☆976Updated last year
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆418Updated last week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆584Updated this week
• abgulati / LARS
  An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
  ☆597Updated 7 months ago
• riccardomusmeci / mlx-llm
  Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.
  ☆446Updated 4 months ago
• mustafaaljadery / lightning-whisper-mlx
  An extremely fast implementation of whisper optimized for Apple Silicon using MLX.
  ☆724Updated last year
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆961Updated this week
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆627Updated this week
• LlamaEdge / LlamaEdge
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆1,431Updated last week
• Blaizzy / mlx-vlm
  MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
  ☆1,347Updated 2 weeks ago
• withcatai / node-llama-cpp
  Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation le…
  ☆1,549Updated last week
• dezoito / ollama-grid-search
  A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.
  ☆757Updated 2 months ago
• NousResearch / Hermes-Function-Calling
  ☆900Updated 9 months ago
• HazyResearch / minions
  Big & Small LLMs working together
  ☆972Updated this week
• huggingface / transformers.js-examples
  A collection of 🤗 Transformers.js demos and example applications
  ☆1,603Updated 2 weeks ago
• menloresearch / cortex.cpp
  Local AI API Platform
  ☆2,753Updated last week
• mlc-ai / web-llm-chat
  Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
  ☆769Updated last month
• codestoryai / sidecar
  Sidecar is the AI brains for the Aide editor and works alongside it, locally on your machine
  ☆570Updated last month
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆137Updated 11 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆194Updated 4 months ago
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆152Updated last year
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆249Updated last week