Alternatives and similar repositories for llama-box

Users that are interested in llama-box are comparing it to the libraries listed below

• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆221Updated 4 months ago
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆186Updated last week
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆259Updated 9 months ago
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆68Updated this week
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆158Updated 3 months ago
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆758Updated this week
• and270 / thinking_effort_processor
  ☆94Updated 5 months ago
• sasha0552 / pascal-pkgs-ci
  The main repository for building Pascal-compatible versions of ML applications and libraries.
  ☆158Updated 4 months ago
• thad0ctor / llama-server-launcher
  ☆108Updated 2 weeks ago
• rag-wtf / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆164Updated last year
• andrewkchan / deepseek.cpp
  CPU inference for the DeepSeek family of large language models in C++
  ☆317Updated 2 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆104Updated 2 weeks ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆218Updated last week
• OpenSQZ / MiniCPM-V-CookBook
  Cook up amazing multimodal AI applications effortlessly with MiniCPM-o
  ☆230Updated 3 weeks ago
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆143Updated this week
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆267Updated 9 months ago
• HimariO / llama.cpp.qwen2.5vl
  Port of Facebook's LLaMA model in C/C++
  ☆66Updated 8 months ago
• wade1010 / graphrag-ui
  The latest graphrag interface is used, using the local ollama to provide the LLM interface.Support for using the pip installation
  ☆155Updated last year
• vtuber-plan / olah
  Self-hosted huggingface mirror service. 自建huggingface镜像服务。
  ☆211Updated 5 months ago
• chigkim / Ollama-MMLU-Pro
  ☆109Updated 4 months ago
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆551Updated last month
• AaronFeng753 / Better-Qwen3
  Auto Thinking Mode switch for Qwen3 in Open webui
  ☆70Updated 7 months ago
• modelscope / modelscope-studio
  A third-party component library based on Gradio. Integrates Ant Design, Ant Design X, Monaco Editor and more advanced components to help…
  ☆132Updated last month
• iluxu / llmbasedos
  llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work
  ☆279Updated 4 months ago
• denser-org / denser-retriever
  An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.
  ☆292Updated 6 months ago
• gpustack / gpustack-ui
  ☆65Updated this week
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆118Updated last year
• aneeshjoy / vllm-windows
  Docker compose to run vLLM on Windows
  ☆112Updated last year
• chisasaw / redcache-ai
  A memory framework for Large Language Models and Agents.
  ☆182Updated last year
• AIAnytime / SmolDocling-OCR-App
  SmolDocling OCR App built using SmolDocling 256M Model and Streamlit.
  ☆223Updated 9 months ago