An intelligent load balancer for LM Studio that distributes requests across multiple loaded language models, optimizing resource utilization and response times.
☆21Oct 13, 2025Updated 11 months ago
Alternatives and similar repositories for lm-studio-loadbalancer
Users that are interested in lm-studio-loadbalancer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repo maintains a 'cheat sheet' for LLMs that are undertrained on mlx☆33Mar 12, 2026Updated 6 months ago
- A proxy for minimax-m2, enabling interleaved thinking, and tool calls.☆38Nov 21, 2025Updated 9 months ago
- ☆77Nov 22, 2024Updated last year
- A modified Codex CLI application built to support local LLMs☆73Updated this week
- A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.☆89Nov 11, 2025Updated 10 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆19Apr 11, 2026Updated 5 months ago
- Code for EMNLP 2023 paper: DALE: Generative Data Augmentation for Low-Resource Legal NLP☆11Oct 27, 2023Updated 2 years ago
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- bootstrap my zsh shell☆16Mar 28, 2026Updated 5 months ago
- OpenSource deployment made easy☆10Jun 13, 2015Updated 11 years ago
- ☆13May 13, 2024Updated 2 years ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.☆11May 26, 2023Updated 3 years ago
- Adapter / facade for language models (OpenAI, Anthropic, Cohere, local transformers, etc)☆20Sep 21, 2023Updated 2 years ago
- ☆15Jun 13, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- An OpenAI API compatible FastAPI server that sits on top of the Anemll repo. Tested with Open WebUI.☆21Jan 21, 2026Updated 7 months ago
- Oobabooga Text-Gen Web UI extension: get web content, add to context☆22Jun 1, 2024Updated 2 years ago
- A rule based sentence segmentation library.☆14Jul 17, 2023Updated 3 years ago
- MLX binary vectors and associated algorithms.☆14Mar 13, 2025Updated last year
- Example tutorials for twarc v2☆12Jul 30, 2021Updated 5 years ago
- A demo of a data science project using Kedro☆17Dec 3, 2021Updated 4 years ago
- Implementation of a fast semantic chunker in C++, installable in python 3.7+ projects.☆22Sep 20, 2025Updated last year
- ☆20Apr 8, 2025Updated last year
- The end of Screenshot 2023-12-20-21.11.59.png☆15Dec 22, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Triton‑style kernel toolkit for MLX plus a small upstream incubator: prototype, benchmark, and upstream fusions for Apple Silicon☆53Mar 31, 2026Updated 5 months ago
- MMLU-Pro eval results☆15Aug 21, 2025Updated last year
- The homepage for ConvSearch Dataset.☆14May 31, 2022Updated 4 years ago
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆145Apr 15, 2026Updated 5 months ago
- An MLX implementation of Meta AI's ESM-2 protein language model☆16Aug 16, 2025Updated last year
- A tool for migrating projects with hard-coded strings to Tolgee JS☆21Nov 14, 2024Updated last year
- 基于nodejs koa的微信JS-SDK通用授权服务器☆11Jan 23, 2018Updated 8 years ago
- The Advanced Interview Responder uses AI to generate tailored responses from a user’s resume and real-time transcribed questions, display…☆12Jan 6, 2025Updated last year
- A lightweight, easy-to-use Model Context Protocol (MCP) implementation that seamlessly integrates Perplexity's powerful AI models into Cl…☆15Feb 28, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A simple, cross-platform CLI tool for quickly switching between Claude Code configuration profiles by managing different settings.json ve…☆18Jan 17, 2026Updated 8 months ago
- A local-first knowledge layer over your email archive that turns long-term history into source-attributed memory surfaces.☆20Jul 8, 2026Updated 2 months ago
- Reverse engineering toolkit for Apple Silicon private APIs. 55+ Apple Intelligence models mapped, Metal 4 ML pipeline, 1009 IOReport chan…☆19Mar 26, 2026Updated 5 months ago
- 微服务，支付服务，go-gprc微服务，kelvins-io/kelvins☆12Jul 19, 2022Updated 4 years ago
- skill.md specialized skill registry for AI agents☆15Apr 24, 2026Updated 4 months ago
- The demo is a Hacker News clone and uses RedisJSON for storing the data and RediSearch for searching.☆16Jun 30, 2023Updated 3 years ago
- A Scheduler for Batched LLM Inference☆19Oct 5, 2025Updated 11 months ago