bodaay / HuggingFaceModelDownloader

Related projects ⓘ

Alternatives and complementary repositories for HuggingFaceModelDownloader

• theroyallab / tabbyAPI
  An OAI compatible exllamav2 API that's both lightweight and fast
  ☆605Updated this week
• turboderp / exui
  Web UI for ExLlamaV2
  ☆445Updated last month
• PygmalionAI / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,134Updated this week
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆126Updated 6 months ago
• mamei16 / LLM_Web_search
  An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo
  ☆173Updated this week
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆202Updated last month
• casper-hansen / AutoAWQ
  AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:
  ☆1,765Updated this week
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆244Updated 2 weeks ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆140Updated this week
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆208Updated last month
• zenoverflow / omnichain
  Efficient visual programming for AI language models
  ☆299Updated 2 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆172Updated 6 months ago
• kvcache-ai / ktransformers
  A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
  ☆737Updated last week
• jondurbin / airoboros
  Customizable implementation of the self-instruct paper.
  ☆1,024Updated 8 months ago
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆272Updated 4 months ago
• turboderp / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆3,680Updated this week
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆701Updated last week
• AI-Commandos / LLaMa2lang
  Convenience scripts to finetune (chat-)LLaMa3 and other models for any language
  ☆280Updated 5 months ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆493Updated 3 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers model
  ☆162Updated 6 months ago
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆252Updated 3 months ago
• e-p-armstrong / augmentoolkit
  Convert Compute And Books Into Instruct-Tuning Datasets! Makes: QA, RP, Classifiers.
  ☆1,033Updated last week
• cognitivecomputations / dolphin-system-messages
  Dolphin System Messages
  ☆202Updated 2 months ago
• matatonic / openedai-speech
  An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.
  ☆476Updated 2 months ago
• av / harbor
  Effortlessly run LLM backends, APIs, frontends, and services with one command.
  ☆531Updated this week
• tcsenpai / multi1
  multi1: create o1-like reasoning chains with multiple AI providers (and locally). Supports LiteLLM as backend too for 100+ providers at o…
  ☆314Updated last month
• mzbac / qlora-fine-tune
  ☆168Updated last year
• NVIDIA / RULER
  This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?
  ☆723Updated 3 weeks ago
• galatolofederico / microchain
  function calling-based LLM agents
  ☆278Updated 2 months ago
• AndrewVeee / nucleo-ai
  An AI assistant beyond the chat box.
  ☆315Updated 8 months ago