Alternatives and similar repositories for picollm

Users that are interested in picollm are comparing it to the libraries listed below

• Picovoice / pico-cookbook
  Recipes for on-device voice AI and local LLM
  ☆82Updated this week
• Picovoice / orca
  On-device streaming text-to-speech engine powered by deep learning
  ☆79Updated last week
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆180Updated 3 months ago
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆174Updated 7 months ago
• onnx / turnkeyml
  Local LLM Server with NPU Acceleration
  ☆180Updated last week
• chigkim / Ollama-MMLU-Pro
  ☆89Updated 4 months ago
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆182Updated 8 months ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆562Updated 3 months ago
• isaiahbjork / orpheus-tts-local
  Run Orpheus 3B Locally With LM Studio
  ☆401Updated last month
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆701Updated 2 weeks ago
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆60Updated 10 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆473Updated this week
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆175Updated this week
• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆43Updated 7 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated last year
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆166Updated this week
• pinokiocomputer / llamanet
  Replace OpenAI with Llama.cpp Automagically.
  ☆317Updated 11 months ago
• senstella / parakeet-mlx
  An implementation of the Nvidia's Parakeet models for Apple Silicon using MLX.
  ☆152Updated this week
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆311Updated last year
• mehtabmahir / easy-whisper-ui
  Easy to use interface for the Whisper model optimized for all GPUs!
  ☆202Updated 2 weeks ago
• babycommando / entity-db
  EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly
  ☆154Updated last week
• flatsiedatsie / papeg_ai
  Code for Papeg.ai
  ☆223Updated 4 months ago
• AIWintermuteAI / whispercpp
  Pybind11 bindings for Whisper.cpp
  ☆57Updated 2 weeks ago
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆259Updated 9 months ago
• remichu-ai / gallama
  ☆130Updated 2 weeks ago
• freddyaboulton / orpheus-cpp
  Fast Streaming TTS with Orpheus + WebRTC (with FastRTC)
  ☆274Updated last month
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆91Updated last month
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆114Updated 2 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆187Updated 10 months ago
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆266Updated this week