nath1295 / MLX-Textgen
A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
☆55Updated this week
Related projects ⓘ
Alternatives and complementary repositories for MLX-Textgen
- Very basic framework for parameterized large language model (Q)LoRa fine-tuning using mlx, mlx_lm, and OgbujiPT. Architecture for system…☆35Updated this week
- Routing on Random Forest (RoRF)☆84Updated last month
- Distributed Inference for mlx LLm☆70Updated 3 months ago
- ☆38Updated 8 months ago
- Scripts to create your own moe models using mlx☆86Updated 8 months ago
- Simple examples using Argilla tools to build AI☆42Updated this week
- For inferring and serving local LLMs using the MLX framework☆89Updated 8 months ago
- entropix style sampling + GUI☆25Updated 3 weeks ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆30Updated 5 months ago
- Implementation of nougat that focuses on processing pdf locally.☆74Updated 6 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆55Updated 3 months ago
- Official homepage for "Self-Harmonized Chain of Thought"☆83Updated 2 months ago
- ☆104Updated 8 months ago
- ☆112Updated this week
- Large Model Proxy is designed to make it easy to run multiple resource-heavy Large Models (LM) on the same machine with limited amount of…☆47Updated last month
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆110Updated 6 months ago
- ☆64Updated 5 months ago
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆21Updated 5 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆57Updated 4 months ago
- Fast parallel LLM inference for MLX☆149Updated 4 months ago
- Synthify: Seamlessly generate ai datasets with a no-code UI☆45Updated 4 months ago
- ☆128Updated this week
- All the world is a play, we are but actors in it.☆47Updated 4 months ago
- ☆94Updated 2 months ago
- MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.☆77Updated last month
- A little file for doing LLM-assisted prompt expansion and image generation using Flux.schnell - complete with prompt history, prompt queu…☆25Updated 3 months ago
- look how they massacred my boy☆58Updated last month
- ☆53Updated 5 months ago