An intelligent load balancer for LM Studio that distributes requests across multiple loaded language models, optimizing resource utilization and response times.
☆21Oct 13, 2025Updated 10 months ago
Alternatives and similar repositories for lm-studio-loadbalancer
Users that are interested in lm-studio-loadbalancer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- mlx-lm server wrapper for agentic harness☆21Jan 26, 2026Updated 7 months ago
- This repo maintains a 'cheat sheet' for LLMs that are undertrained on mlx☆33Mar 12, 2026Updated 5 months ago
- 🕸️ The Webb Relayer Network☆23May 7, 2024Updated 2 years ago
- A proxy for minimax-m2, enabling interleaved thinking, and tool calls.☆39Nov 21, 2025Updated 9 months ago
- ☆77Nov 22, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- LM Studio localization☆210Aug 21, 2026Updated last week
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆18Apr 11, 2026Updated 4 months ago
- Code for EMNLP 2023 paper: DALE: Generative Data Augmentation for Low-Resource Legal NLP☆11Oct 27, 2023Updated 2 years ago
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- A Python Wrapper To Retrieve Data From The CrowdTangle API☆11Mar 26, 2026Updated 5 months ago
- Monorepo for the Tangle ecosystem.☆36Jul 30, 2026Updated last month
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 4 months ago
- ☆13May 13, 2024Updated 2 years ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Fast & safe Apple Mail search CLI with body content support☆17May 23, 2026Updated 3 months ago
- Adapter / facade for language models (OpenAI, Anthropic, Cohere, local transformers, etc)☆20Sep 21, 2023Updated 2 years ago
- LM_Chat_TTS_FrontEnd is a simple yet powerful interface for interacting with LM Studio models using text-to-speech functionality. This pr…☆17Feb 11, 2024Updated 2 years ago
- ☆15Jun 13, 2025Updated last year
- Oobabooga Text-Gen Web UI extension: get web content, add to context☆22Jun 1, 2024Updated 2 years ago
- A rule based sentence segmentation library.☆14Jul 17, 2023Updated 3 years ago
- Implementation of a fast semantic chunker in C++, installable in python 3.7+ projects.☆22Sep 20, 2025Updated 11 months ago
- ☆20Apr 8, 2025Updated last year
- 🚥 Quickly set the style of Anybar☆14Jun 17, 2021Updated 5 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX☆61Feb 9, 2024Updated 2 years ago
- The end of Screenshot 2023-12-20-21.11.59.png☆15Dec 22, 2023Updated 2 years ago
- Triton‑style kernel toolkit for MLX plus a small upstream incubator: prototype, benchmark, and upstream fusions for Apple Silicon☆52Mar 31, 2026Updated 5 months ago
- MMLU-Pro eval results☆15Aug 21, 2025Updated last year
- Crop your perfect headshot with AI!☆14Sep 23, 2020Updated 5 years ago
- Python implementation of YiChang Shih's "Style Transfer for Headshots Portraits" [http://www.connellybarnes.com/work/publications/2014_po…☆16Sep 11, 2019Updated 6 years ago
- Full Stack AI Mock Interview App with Next.js! 💻 In this tutorial, we'll use React, Drizzle ORM, Gemini AI, and Clerk to create a power…☆33Mar 25, 2025Updated last year
- FastMLX is a high performance production ready API to host MLX models.☆24Nov 18, 2024Updated last year
- A Model Context Protocol server for Scrapybara☆17Mar 18, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆17Feb 23, 2026Updated 6 months ago
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆146Apr 15, 2026Updated 4 months ago
- An MLX implementation of Meta AI's ESM-2 protein language model☆16Aug 16, 2025Updated last year
- A tool for migrating projects with hard-coded strings to Tolgee JS☆21Nov 14, 2024Updated last year
- The Advanced Interview Responder uses AI to generate tailored responses from a user’s resume and real-time transcribed questions, display…☆12Jan 6, 2025Updated last year
- ☆18May 27, 2025Updated last year
- Ai chat assistant webpage utilising OpenAI's gpt-4o-mini.☆27Feb 14, 2025Updated last year