A custom LiteLLM provider enabling local execution of Hugging Face models with streaming, quantization, and async support
☆31Jun 22, 2025Updated last year
Alternatives and similar repositories for litellm-hf-local
Users that are interested in litellm-hf-local are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Yet Another (LLM) Web UI, made with Gemini☆12Dec 25, 2024Updated last year
- An fully autonomous agent that accesses the browser and performs tasks.☆18Aug 17, 2026Updated last month
- A natural language file search tool that uses LLMs to help you find files by describing what you're looking for.☆28Mar 8, 2025Updated last year
- This repository is a CUA (computer use agent) system that, using the Qwen3-VL model on Ubuntu computers, aims to perform tasks on your be…☆24Mar 3, 2026Updated 7 months ago
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆29May 6, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆30Mar 15, 2025Updated last year
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆21Jun 25, 2024Updated 2 years ago
- ☆24Sep 20, 2025Updated last year
- llama-swap + a minimal ollama compatible api☆63Sep 29, 2026Updated 2 weeks ago
- ☆23Jan 18, 2025Updated last year
- HanaVerse is a interactive web UI for chatting with ollama with a lively 2D anime character Hana. Star it on GitHub!☆72May 17, 2025Updated last year
- Run Orpheus 3B Locally With LM Studio☆32Mar 20, 2025Updated last year
- One stop shop - Local-first RAG stack with intelligent polyglot-code/docs, remote code execution, local llama enrichment, progressive dis…☆36Feb 17, 2026Updated 7 months ago
- Deep Diff Pizza is a simple, 0 dependency utility function that takes in 2 JSON Objects and returns the differences in an easy-to-use for…☆11Aug 8, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Provides pipeAsync and traversePromises functions that play well with the rest of Ramda ecosystem.☆12Jan 30, 2024Updated 2 years ago
- A Python utility for seamless import and export of n8n workflows and credentials. Automates migration between environments, simplifies ba…☆13Apr 8, 2025Updated last year
- A bare-bones GUI application for the local inference engine, llama.cpp. Built-in TPE optimiser to find the best flags for your system☆18Sep 6, 2026Updated last month
- Qwen3.8-Flash-Next (NVFP4) on DGX Spark in vLLM: one Spark 43.9 tok/s with our disk-backed n-gram table patch, staged gather and reduced-…☆128Sep 7, 2026Updated last month
- Offline LLM chatbot with personalized memory — works on CPU with multi-session memory support.☆22Jan 10, 2026Updated 9 months ago
- Replayable Browser Agent☆17Apr 24, 2026Updated 5 months ago
- A convenient way to install and configure the appropriate version of PyTorch on the user's computer, based on the OS and GPU manufacturer…☆15Oct 1, 2026Updated last week
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆32May 1, 2025Updated last year
- A TypeScript/JavaScript implementation of the RDF/JS data factory.☆13Sep 24, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Simulates talk with an AI that can express emotions☆90Apr 4, 2026Updated 6 months ago
- Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.☆42Jul 2, 2025Updated last year
- ☆18Apr 10, 2023Updated 3 years ago
- Speech-to-speech AI assistant with natural conversation flow, mid-speech interruption, vision capabilities and AI-initiated follow-ups. F…☆316Apr 14, 2025Updated last year
- MCP Server for reasoning☆15Apr 16, 2025Updated last year
- Example using `Rollup` to bundle k6 tests and release a shared library.☆13May 27, 2026Updated 4 months ago
- Create a localization file from a Google Spreadsheet☆11Oct 31, 2025Updated 11 months ago
- Strix Halo inference engine. Qwen Flash Next Q4_K_XL: 1,702.93pp, 65.25tg single user, 184.74 tok/s 8 users; Qwen27B Q4_K_XL: 656.33pp, 7…☆695Updated this week
- A Field-Theoretic Approach to Unbounded Memory in Large Language Models☆20Apr 15, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- MCP server for managing Roo's custom operational modes☆29Jan 25, 2025Updated last year
- Minimal web client for chatting and roleplay with AI characters☆30Aug 21, 2025Updated last year
- Command line utility to compile a JS project from ES modules to CommonJS☆18Sep 29, 2026Updated 2 weeks ago
- Web application for roleplaying with AI-powered characters☆69Jul 8, 2025Updated last year
- Service for testing out the new Qwen2.5 omni model☆62Apr 30, 2025Updated last year
- A AI avatar generator for video platforms.☆24Jan 19, 2025Updated last year
- AI Agent examples with TypeScript☆19Oct 27, 2025Updated 11 months ago