Alternatives and similar repositories for wllama:

Users that are interested in wllama are comparing it to the libraries listed below

• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆257Updated 9 months ago
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆689Updated 5 months ago
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆747Updated last week
• lmstudio-ai / mlx-engine
  Apple MLX engine for LM Studio
  ☆535Updated last week
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆297Updated last month
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆692Updated 3 weeks ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆556Updated 2 months ago
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,405Updated last week
• Blaizzy / mlx-vlm
  MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
  ☆1,228Updated this week
• tantaraio / voy
  🕸️🦀 A WASM vector similarity search written in Rust
  ☆951Updated last year
• NousResearch / Hermes-Function-Calling
  ☆863Updated 7 months ago
• HazyResearch / minions
  Big & Small LLMs working together
  ☆733Updated this week
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆148Updated last year
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆579Updated last week
• riccardomusmeci / mlx-llm
  Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.
  ☆442Updated 3 months ago
• mlc-ai / web-llm-chat
  Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
  ☆732Updated this week
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆235Updated this week
• pinokiocomputer / llamanet
  Replace OpenAI with Llama.cpp Automagically.
  ☆318Updated 10 months ago
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆202Updated 8 months ago
• mustafaaljadery / lightning-whisper-mlx
  An extremely fast implementation of whisper optimized for Apple Silicon using MLX.
  ☆696Updated 11 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆185Updated 3 months ago
• asg017 / sqlite-lembed
  A SQLite extension for generating text embeddings from GGUF models using llama.cpp
  ☆185Updated 5 months ago
• mustafaaljadery / mlxserver
  Start a server from the MLX library.
  ☆185Updated 9 months ago
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆351Updated 10 months ago
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆264Updated this week
• PABannier / bark.cpp
  Suno AI's Bark model in C/C++ for fast text-to-speech generation
  ☆808Updated 5 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆335Updated last week
• huggingface / transformers.js-examples
  A collection of 🤗 Transformers.js demos and example applications
  ☆1,438Updated 2 weeks ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆400Updated this week
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆350Updated 3 weeks ago