Alternatives and similar repositories for ollama-dl

Users that are interested in ollama-dl are comparing it to the libraries listed below

• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆158Updated 3 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆197Updated last week
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 6 months ago
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆278Updated last week
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆197Updated last week
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆255Updated this week
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆49Updated 3 months ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆116Updated last year
• matteoserva / GraphLLM
  ☆208Updated last month
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆259Updated 5 months ago
• sammcj / llamalink
  Link you Ollama models to LM-Studio
  ☆141Updated last year
• teabranch / open-responses-server
  Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…
  ☆83Updated last month
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆80Updated 11 months ago
• iluxu / llmbasedos
  llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work
  ☆267Updated last week
• m18coppola / llama.sh
  No-messing-around sh client for llama.cpp's server
  ☆30Updated last year
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆56Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆195Updated this week
• AIWintermuteAI / whispercpp
  Pybind11 bindings for Whisper.cpp
  ☆61Updated 3 weeks ago
• chigkim / Ollama-MMLU-Pro
  ☆95Updated 7 months ago
• Mozilla-Ocho / llamafile-rag-example
  ☆90Updated last year
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆100Updated last month
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆479Updated 3 weeks ago
• huggingface / local-gemma
  Gemma 2 optimized for your local machine.
  ☆377Updated last year
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆145Updated 2 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆99Updated 2 weeks ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆129Updated 2 years ago
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆61Updated last year
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆674Updated last week