An intelligent load balancer for LM Studio that distributes requests across multiple loaded language models, optimizing resource utilization and response times.
☆21Oct 13, 2025Updated last year
Alternatives and similar repositories for lm-studio-loadbalancer
Users that are interested in lm-studio-loadbalancer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- mlx-lm server wrapper for agentic harness☆21Jan 26, 2026Updated 9 months ago
- This repo maintains a 'cheat sheet' for LLMs that are undertrained on mlx☆33Mar 12, 2026Updated 7 months ago
- ☆10Feb 23, 2025Updated last year
- Toolbox for Unsupervised Anomaly Detection on MVTec AD☆11Apr 23, 2021Updated 5 years ago
- This repository demonstrates how to fine-tune the Google Gemma 2 2B model to improve its performance on Japanese instruction-following ta…☆12Aug 11, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A proxy for minimax-m2, enabling interleaved thinking, and tool calls.☆38Nov 21, 2025Updated 11 months ago
- ⚡ Full-stack AI chat app with Agno Agent Skills, Claude Sonnet 4.6 via OpenRouter, Tavily web search, and Neubrutalism UI☆11Feb 19, 2026Updated 8 months ago
- ☆77Nov 22, 2024Updated last year
- ☆11Nov 8, 2025Updated 11 months ago
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆20Apr 11, 2026Updated 6 months ago
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- ☆13May 13, 2024Updated 2 years ago
- ☆16Jan 3, 2026Updated 9 months ago
- Verified Qwen3.8 Flash Next oMLX Lightning MTP deployment guide for Apple Silicon☆14Aug 30, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Automatic pitch deck generator for Google Sheets (v0.1)☆11Feb 24, 2023Updated 3 years ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- An open JSON format and local toolchain for carrying an AI assisted project's working state between agents, tools and model providers.☆18Oct 16, 2026Updated 2 weeks ago
- OpenSource deployment made easy☆10Jun 13, 2015Updated 11 years ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.☆11May 26, 2023Updated 3 years ago
- The first human cognitive framework integrated into an LLM — now as a Claude Cowork plugin☆13Feb 16, 2026Updated 8 months ago
- Various files of sometimes useful code snippits to use with Ollama☆10Jan 27, 2025Updated last year
- makeyouravatar-zimage☆11Dec 10, 2025Updated 10 months ago
- Example tutorials for twarc v2☆12Jul 30, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Clone a mobile app into a working Expo / React Native project from screenshots. An open-source Claude Code skill.☆17Jul 16, 2026Updated 3 months ago
- ☆15Jun 13, 2025Updated last year
- 🚥 Quickly set the style of Anybar☆14Jun 17, 2021Updated 5 years ago
- Business management assistant with Google Workspace integration☆16Jan 3, 2026Updated 9 months ago
- ☆19Sep 9, 2026Updated last month
- ATS Resume Tracker leverages Google Generative AI to optimize resumes against job descriptions, offering match percentages and skill enha…☆16Sep 19, 2024Updated 2 years ago
- Demo integrating Pinecone with Neo4j to analyze and explore Supreme Court cases.☆11Oct 26, 2026Updated last week
- Batching utility for Stanza☆11Mar 20, 2021Updated 5 years ago
- A self-hosted studio for songs, album covers and music videos. Runs on one Linux GPU machine and serves your home network; pick a local o…☆21Oct 13, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Adapter / facade for language models (OpenAI, Anthropic, Cohere, local transformers, etc)☆20Sep 21, 2023Updated 3 years ago
- MMLU-Pro eval results☆15Aug 21, 2025Updated last year
- The end of Screenshot 2023-12-20-21.11.59.png☆15Dec 22, 2023Updated 2 years ago
- MLX binary vectors and associated algorithms.☆14Mar 13, 2025Updated last year
- ☆12Apr 22, 2024Updated 2 years ago
- A rule based sentence segmentation library.☆14Jul 17, 2023Updated 3 years ago
- FastMLX is a high performance production ready API to host MLX models.☆24Nov 18, 2024Updated last year