Alternatives and similar repositories for picollm

Users that are interested in picollm are comparing it to the libraries listed below

• Picovoice / orca
  On-device streaming text-to-speech engine powered by deep learning
  ☆87Updated last week
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆214Updated last year
• Picovoice / pico-cookbook
  Recipes for on-device voice AI and local LLM
  ☆88Updated 2 weeks ago
• AIWintermuteAI / esp32-llm
  Running a LLM on the ESP32
  ☆70Updated 8 months ago
• google-ai-edge / LiteRT-LM
  ☆234Updated this week
• mustafaaljadery / mlxserver
  Start a server from the MLX library.
  ☆187Updated 11 months ago
• shahizat / JetsonGPT
  Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech
  ☆120Updated 2 years ago
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆204Updated 3 weeks ago
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆273Updated last week
• AIWintermuteAI / whispercpp
  Pybind11 bindings for Whisper.cpp
  ☆58Updated 3 weeks ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆187Updated last week
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆175Updated 9 months ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆573Updated 4 months ago
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆308Updated 3 months ago
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆174Updated last month
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆187Updated 10 months ago
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆154Updated last year
• transformerlab / transformerlab-api
  API Server for Transformer Lab
  ☆66Updated this week
• callbacked / os1
  A lightweight recreation of OS1/Samantha from the movie Her, running locally in the browser
  ☆101Updated 2 months ago
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆139Updated 3 weeks ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆349Updated 9 months ago
• cfahlgren1 / webllm-playground
  Run LLMs in the Browser with MLC / WebLLM ✨
  ☆135Updated 8 months ago
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆750Updated 2 weeks ago
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 4 months ago
• freddyaboulton / orpheus-cpp
  Fast Streaming TTS with Orpheus + WebRTC (with FastRTC)
  ☆294Updated 2 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆72Updated 8 months ago
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆119Updated 3 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆93Updated 10 months ago
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆95Updated last week
• dynamiccreator / voice-text-reader
  Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)
  ☆52Updated 8 months ago