Alternatives and similar repositories for ollama-dl

Users that are interested in ollama-dl are comparing it to the libraries listed below

• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆166Updated 7 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆221Updated 4 months ago
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 10 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆219Updated 2 months ago
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆319Updated 2 weeks ago
• kalavai-net / kalavai-client
  A platform to self-host AI on easy mode
  ☆181Updated 2 weeks ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆118Updated last year
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆294Updated last month
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆267Updated 9 months ago
• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆266Updated this week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆85Updated last week
• chigkim / Ollama-MMLU-Pro
  ☆109Updated 4 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆104Updated last week
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆130Updated 2 years ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆99Updated last year
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆85Updated 7 months ago
• teabranch / open-responses-server
  Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…
  ☆139Updated last month
• theroyallab / YALS
  ☆87Updated 2 weeks ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated 2 years ago
• matteoserva / GraphLLM
  ☆210Updated 3 months ago
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆59Updated last year
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆143Updated this week
• AaronFeng753 / Ollama-Model-Dumper
  Export and Backup Ollama models into GGUF and ModelFile
  ☆89Updated last year
• theroyallab / llm-prompt-templates
  Prompt Jinja2 templates for LLMs
  ☆35Updated 5 months ago
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆310Updated last year
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆86Updated last year
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆605Updated last week
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆51Updated 7 months ago
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆340Updated 5 months ago
• Mozilla-Ocho / llamafile-rag-example
  ☆94Updated last year