Alternatives and similar repositories for ollama-dl

Users that are interested in ollama-dl are comparing it to the libraries listed below

• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆159Updated 4 months ago
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆291Updated last month
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆204Updated 3 weeks ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆116Updated last year
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆259Updated 6 months ago
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 7 months ago
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆296Updated 10 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆199Updated this week
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆274Updated 3 weeks ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆129Updated 2 years ago
• chigkim / Ollama-MMLU-Pro
  ☆98Updated 3 weeks ago
• sammcj / llamalink
  Link you Ollama models to LM-Studio
  ☆141Updated last year
• matteoserva / GraphLLM
  ☆209Updated this week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆102Updated 2 weeks ago
• mark-lord / MLX-text-completion-notebook
  A simple Jupyter Notebook for learning MLX text-completion fine-tuning!
  ☆121Updated 10 months ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆210Updated this week
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆513Updated 7 months ago
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆50Updated 3 months ago
• kalavai-net / kalavai-client
  A platform to self-host AI on easy mode
  ☆161Updated last week
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆80Updated 11 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆95Updated 2 months ago
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆326Updated 5 months ago
• sam-paech / slop-forensics
  ☆264Updated 3 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆82Updated last week
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆61Updated last year
• huggingface / local-gemma
  Gemma 2 optimized for your local machine.
  ☆375Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆187Updated last year
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆273Updated last year
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆100Updated 2 weeks ago