Alternatives and similar repositories for wllama

Users that are interested in wllama are comparing it to the libraries listed below

• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆284Updated last year
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆719Updated 11 months ago
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆164Updated last year
• mlc-ai / web-llm-chat
  Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
  ☆870Updated 2 months ago
• babycommando / entity-db
  EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly
  ☆236Updated 6 months ago
• intentee / paddler
  Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙
  ☆1,360Updated 3 weeks ago
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆1,043Updated last week
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆606Updated 8 months ago
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆332Updated 7 months ago
• google-ai-edge / LiteRT-LM
  ☆468Updated this week
• lmstudio-ai / mlx-engine
  LM Studio Apple MLX engine
  ☆814Updated 2 weeks ago
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆220Updated last year
• tantaraio / voy
  🕸️🦀 A WASM vector similarity search written in Rust
  ☆1,005Updated 2 years ago
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆272Updated this week
• LlamaEdge / LlamaEdge
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆1,537Updated 3 weeks ago
• HazyResearch / minions
  Big & Small LLMs working together
  ☆1,194Updated this week
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆740Updated this week
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,583Updated this week
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆304Updated 7 months ago
• belladoreai / llama3-tokenizer-js
  JS tokenizer for LLaMA 3 and LLaMA 3.1
  ☆116Updated 3 months ago
• janhq / cortex.cpp
  Local AI API Platform
  ☆2,761Updated 4 months ago
• mustafaaljadery / lightning-whisper-mlx
  An extremely fast implementation of whisper optimized for Apple Silicon using MLX.
  ☆805Updated last year
• abgulati / LARS
  An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
  ☆620Updated last year
• Blaizzy / mlx-vlm
  MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
  ☆1,817Updated this week
• poloclub / mememo
  A JavaScript library that brings vector search and RAG to your browser!
  ☆157Updated last year
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆596Updated 3 weeks ago
• Stevenic / vectra
  Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.
  ☆536Updated 6 months ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆140Updated last year
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 9 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆227Updated last year