Alternatives and similar repositories for ollama-dl

Users that are interested in ollama-dl are comparing it to the libraries listed below

• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆36Updated last year
• jndiogo / sibila
  Extract structured data from local or remote LLM models
  ☆42Updated 10 months ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆136Updated 2 weeks ago
• AIWintermuteAI / whispercpp
  Pybind11 bindings for Whisper.cpp
  ☆57Updated last week
• bold84 / cot_proxy
  A lightweight proxy for filtering `<think>` tags from any OpenAI-compatible API endpoint. Designed for chain-of-thought language models t…
  ☆37Updated 3 months ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• 3eeps / cherry-py
  simple prompt script to convert hf/ggml files to gguf, and to quantize
  ☆26Updated last year
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆76Updated this week
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆180Updated 3 months ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated 11 months ago
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆60Updated 10 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆123Updated last year
• rodrigobaron / anthill
  ☆24Updated 3 months ago
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• Mozilla-Ocho / llamafile-rag-example
  ☆87Updated 11 months ago
• FarFetchd / sleepyllama
  an auto-sleeping and -waking framework around llama.cpp
  ☆11Updated 3 months ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆71Updated 7 months ago
• ddh0 / easy-llama
  Text generation in Python, as easy as possible
  ☆60Updated this week
• cognitivecomputations / OpenChatML
  ☆156Updated 9 months ago
• LeonEricsson / llmcontext
  Pressure testing the context window of open LLMs
  ☆24Updated 8 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆161Updated this week
• d0rc / deepdive
  Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…
  ☆41Updated 8 months ago
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆59Updated last year
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆103Updated last year
• theroyallab / YALS
  ☆69Updated this week
• cfahlgren1 / natural-functions
  Mistral-7B finetuned for function calling
  ☆16Updated last year
• matteoserva / GraphLLM
  ☆202Updated 3 weeks ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆47Updated 7 months ago