Alternatives and similar repositories for wllama

Users that are interested in wllama are comparing it to the libraries listed below

• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆267Updated 10 months ago
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆696Updated 6 months ago
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆764Updated this week
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆774Updated this week
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆241Updated 2 weeks ago
• tantaraio / voy
  🕸️🦀 A WASM vector similarity search written in Rust
  ☆963Updated last year
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆566Updated 3 months ago
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆305Updated 2 months ago
• mlc-ai / web-llm-chat
  Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
  ☆753Updated 3 weeks ago
• abgulati / LARS
  An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
  ☆592Updated 7 months ago
• HazyResearch / minions
  Big & Small LLMs working together
  ☆814Updated this week
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆207Updated 8 months ago
• LlamaEdge / LlamaEdge
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆1,402Updated this week
• pinokiocomputer / llamanet
  Replace OpenAI with Llama.cpp Automagically.
  ☆318Updated 11 months ago
• lmstudio-ai / mlx-engine
  Apple MLX engine for LM Studio
  ☆564Updated 2 weeks ago
• codestoryai / sidecar
  Sidecar is the AI brains for the Aide editor and works alongside it, locally on your machine
  ☆558Updated 2 weeks ago
• dezoito / ollama-grid-search
  A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.
  ☆740Updated last month
• Blaizzy / mlx-vlm
  MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
  ☆1,293Updated this week
• mustafaaljadery / lightning-whisper-mlx
  An extremely fast implementation of whisper optimized for Apple Silicon using MLX.
  ☆706Updated last year
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆149Updated last year
• babycommando / entity-db
  EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly
  ☆168Updated 3 weeks ago
• poloclub / mememo
  A JavaScript library that brings vector search and RAG to your browser!
  ☆119Updated 9 months ago
• b4rtaz / distributed-llama
  Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆2,074Updated last month
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,435Updated this week
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆399Updated this week
• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆986Updated 7 months ago
• lucasjinreal / Kokoros
  🔥🔥 Kokoro in Rust. https://huggingface.co/hexgrad/Kokoro-82M Insanely fast, realtime TTS with high quality you ever have.
  ☆520Updated 3 weeks ago
• ml-explore / mlx-lm
  Run LLMs with MLX
  ☆877Updated this week
• PABannier / bark.cpp
  Suno AI's Bark model in C/C++ for fast text-to-speech generation
  ☆817Updated 6 months ago
• not-pizza / victor
  Web-optimized vector database (written in Rust).
  ☆238Updated 3 months ago