Alternatives and similar repositories for ollama-dl

Users that are interested in ollama-dl are comparing it to the libraries listed below

• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆152Updated last month
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆48Updated last month
• jndiogo / sibila
  Extract structured data from local or remote LLM models
  ☆42Updated last year
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆77Updated this week
• cognitivecomputations / OpenChatML
  ☆157Updated 11 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆67Updated last week
• chigkim / Ollama-MMLU-Pro
  ☆95Updated 6 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• tjmlabs / ColiVarE
  ☆19Updated 4 months ago
• nydasco / jen-ai
  A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.
  ☆45Updated last year
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆244Updated 3 weeks ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆76Updated 9 months ago
• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆43Updated 9 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆184Updated last week
• matteoserva / GraphLLM
  ☆204Updated last month
• lemonade-sdk / lemonade
  Local LLM Server with GPU and NPU Acceleration
  ☆138Updated this week
• DefamationStation / Retrochat-v2
  RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…
  ☆76Updated 3 weeks ago
• fairydreaming / lineage-bench
  Testing LLM reasoning abilities with lineage relationship quizzes.
  ☆28Updated 3 months ago
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 9 months ago
• rodrigobaron / anthill
  ☆24Updated 5 months ago
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆61Updated 11 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 9 months ago
• AIWintermuteAI / whispercpp
  Pybind11 bindings for Whisper.cpp
  ☆58Updated 3 weeks ago
• lmstudio-ai / venvstacks
  Virtual environment stacks for Python
  ☆258Updated this week
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆86Updated this week
• mark-lord / MLX-text-completion-notebook
  A simple Jupyter Notebook for learning MLX text-completion fine-tuning!
  ☆119Updated 7 months ago
• teknium1 / ShareGPT-Builder
  ☆114Updated 6 months ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆35Updated last year
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆187Updated last week