Alternatives and similar repositories for ollama-dl:

Users that are interested in ollama-dl are comparing it to the libraries listed below

• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆73Updated 3 months ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆127Updated 6 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆65Updated last year
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated 10 months ago
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆260Updated 2 weeks ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆71Updated 6 months ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆55Updated last month
• jndiogo / sibila
  Extract structured data from local or remote LLM models
  ☆41Updated 9 months ago
• matteoserva / GraphLLM
  ☆197Updated 2 weeks ago
• Mozilla-Ocho / llamafile-rag-example
  ☆84Updated 9 months ago
• FishiaT / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆11Updated 3 months ago
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆91Updated 9 months ago
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆181Updated 2 months ago
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆112Updated this week
• latent-variable / r1_reasoning_effort
  Forces DeepSeek R1 models to engage in extended reasoning by intercepting early termination tokens.
  ☆19Updated last month
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆21Updated 9 months ago
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆54Updated last year
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 6 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated 11 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• taketwo / llm-ollama
  LLM plugin providing access to models running on an Ollama server
  ☆261Updated 3 weeks ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆143Updated this week
• DefamationStation / Retrochat-v2
  RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…
  ☆72Updated 3 months ago
• smy20011 / MorningRadio
  Generate Your Own Private Morning Radio for Commute
  ☆34Updated last month
• jcosta33 / client-llm-vite
  ☆45Updated 10 months ago
• huggingface / local-gemma
  Gemma 2 optimized for your local machine.
  ☆366Updated 7 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆87Updated 7 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆164Updated last week