Alternatives and similar repositories for picollm:

Users that are interested in picollm are comparing it to the libraries listed below

• Picovoice / orca
  On-device streaming text-to-speech engine powered by deep learning
  ☆73Updated last week
• Picovoice / pico-cookbook
  Recipes for on-device voice AI and local LLM
  ☆79Updated last week
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆215Updated 6 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆183Updated 11 months ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆142Updated this week
• mlc-ai / binary-mlc-llm-libs
  ☆234Updated 4 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• pinokiocomputer / llamanet
  Replace OpenAI with Llama.cpp Automagically.
  ☆311Updated 9 months ago
• usefulsensors / useful-transformers
  Efficient Inference of Transformer models
  ☆427Updated 7 months ago
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆305Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆164Updated this week
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆162Updated this week
• Vaibhavs10 / optimise-my-whisper
  ☆201Updated 10 months ago
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆173Updated 6 months ago
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆178Updated 7 months ago
• kalavai-net / kalavai-client
  Turns devices into a scalable LLM platform
  ☆127Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆222Updated this week
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆243Updated 3 weeks ago
• noco-ai / spellbook-docker
  AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models
  ☆152Updated 10 months ago
• matteoserva / GraphLLM
  ☆197Updated last week
• menloresearch / ichigo-demo
  ☆91Updated 2 months ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆547Updated last month
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆281Updated last week
• akashjss / sesame-csm
  A Conversational Speech Generation Model with Gradio UI and support for CUDA, MLX and CPU devices
  ☆131Updated this week
• chigkim / Ollama-MMLU-Pro
  ☆83Updated 3 months ago
• matatonic / openedai-whisper
  An OpenAI API compatible speech to text server for audio transcription and translations, aka. Whisper.
  ☆71Updated last month
• zenoverflow / omnichain
  Efficient visual programming for AI language models
  ☆353Updated 6 months ago
• isaiahbjork / orpheus-tts-local
  Run Orpheus 3B Locally With LM Studio
  ☆277Updated last week
• shahizat / JetsonGPT
  Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech
  ☆117Updated last year
• lef-fan / aria
  A local and uncensored AI entity.
  ☆69Updated last month