Alternatives and similar repositories for ollama-dl:

Users that are interested in ollama-dl are comparing it to the libraries listed below

• jndiogo / sibila
  Extract structured data from local or remote LLM models
  ☆41Updated 8 months ago
• Mozilla-Ocho / llamafile-rag-example
  ☆79Updated 8 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆102Updated this week
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆58Updated last year
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆22Updated 7 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆53Updated this week
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆72Updated 2 months ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆122Updated 4 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆65Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆154Updated this week
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆54Updated last year
• tolitius / towel
  "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"
  ☆48Updated 4 months ago
• rodrigobaron / anthill
  ☆24Updated 3 weeks ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆114Updated 8 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated 10 months ago
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆181Updated 3 weeks ago
• balisujohn / localpilot
  codellama on CPU without Docker
  ☆25Updated last year
• shinomakoi / AI-Messenger
  A QT GUI for large language models
  ☆30Updated last year
• crashr / gppm
  GPU Power and Performance Manager
  ☆55Updated 4 months ago
• m18coppola / llama.sh
  No-messing-around sh client for llama.cpp's server
  ☆31Updated 6 months ago
• DefamationStation / Retrochat-v2
  RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…
  ☆70Updated 2 months ago
• Toy-97 / Chat-WebUI
  Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools.
  ☆15Updated 3 months ago
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆59Updated 7 months ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆68Updated 4 months ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆46Updated 4 months ago
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆76Updated 3 weeks ago
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆36Updated last year