Alternatives and similar repositories for windows_llama.cpp:

Users that are interested in windows_llama.cpp are comparing it to the libraries listed below

• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 8 months ago
• nydasco / jen-ai
  A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.
  ☆44Updated last year
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆34Updated 2 weeks ago
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆18Updated 5 months ago
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆75Updated 2 months ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆56Updated 5 months ago
• rodrigobaron / anthill
  ☆24Updated 3 months ago
• cp3249 / splaa
  SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…
  ☆27Updated this week
• rombodawg / Easy_training
  ☆47Updated 2 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆54Updated 8 months ago
• laelhalawani / gguf_modeldb
  A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…
  ☆12Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• Edw590 / VISOR---A-Voice-Assistant
  V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!
  ☆35Updated 2 weeks ago
• Forest-Person / smolResearcher
  Use smol agents to do research and then update csv coumns with its findings.
  ☆40Updated 3 months ago
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆94Updated 3 weeks ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year
• FishiaT / Tumera
  Yet another frontend for LLM, written using .NET and WinUI 3
  ☆10Updated 5 months ago
• j-webtek / LLM-Learning
  A repository to store helpful information and emerging insights in regard to LLMs
  ☆20Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆50Updated 11 months ago
• zenforic / csm-multi
  Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…
  ☆23Updated last month
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆109Updated 10 months ago
• severian42 / Mycomind-Daemon-Ollama-Mixture-of-Memory-RAG-Agents
  Mycomind Daemon: A mycelium-inspired, advanced Mixture-of-Memory-RAG-Agents (MoMRA) cognitive assistant that combines multiple AI models …
  ☆32Updated 10 months ago
• TAR-ALEX / llm-html
  ☆16Updated last week
• Ejb503 / ai-voice-generation
  Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …
  ☆37Updated 11 months ago
• l33tkr3w / LlamaCards
  LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …
  ☆39Updated 8 months ago
• andrewginns / CoT-at-Home
  Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.
  ☆41Updated 7 months ago
• Antoine-Villiere / JacQues
  JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.
  ☆22Updated 8 months ago
• slashml / awesome-finetuning
  ☆27Updated 8 months ago
• menloresearch / ichigo-demo
  ☆91Updated 3 months ago