Alternatives and similar repositories for picollm

Users that are interested in picollm are comparing it to the libraries listed below

• Picovoice / orca
  On-device streaming text-to-speech engine powered by deep learning
  ☆85Updated this week
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆267Updated 10 months ago
• Picovoice / pico-cookbook
  Recipes for on-device voice AI and local LLM
  ☆85Updated this week
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆307Updated 2 months ago
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆182Updated 4 months ago
• usefulsensors / ai_in_a_box
  Open source repo for AI in a Box.
  ☆63Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆213Updated last year
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆567Updated 3 months ago
• mustafaaljadery / mlxserver
  Start a server from the MLX library.
  ☆187Updated 10 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆189Updated 11 months ago
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆737Updated last month
• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆43Updated 8 months ago
• mezbaul-h / june
  Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkit
  ☆771Updated 9 months ago
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆174Updated 8 months ago
• lucasnewman / f5-tts-mlx
  Implementation of F5-TTS in MLX
  ☆542Updated 2 months ago
• AIWintermuteAI / whispercpp
  Pybind11 bindings for Whisper.cpp
  ☆57Updated this week
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆199Updated this week
• pdufour / llm-coder
  In-browser LLM website generator
  ☆49Updated 4 months ago
• xenova / kokoro-web
  ML-powered speech synthesis directly in your browser
  ☆156Updated 3 months ago
• Vaibhavs10 / optimise-my-whisper
  ☆204Updated last year
• HazyResearch / minions
  Big & Small LLMs working together
  ☆920Updated this week
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆311Updated last year
• JosefAlbers / whisper-turbo-mlx
  Blazing fast whisper turbo for ASR (speech-to-text) tasks
  ☆208Updated 7 months ago
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆404Updated this week
• freddyaboulton / orpheus-cpp
  Fast Streaming TTS with Orpheus + WebRTC (with FastRTC)
  ☆288Updated last month
• vince-lam / awesome-local-llms
  Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.
  ☆575Updated 3 weeks ago
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆268Updated last week
• abgulati / LARS
  An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
  ☆594Updated 7 months ago
• cfahlgren1 / webllm-playground
  Run LLMs in the Browser with MLC / WebLLM ✨
  ☆131Updated 8 months ago
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆167Updated last week