☆94Jan 24, 2025Updated last year
Alternatives and similar repositories for llm-structured-output
Users that are interested in llm-structured-output are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…☆138Feb 27, 2026Updated 5 months ago
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆43Jun 20, 2025Updated last year
- Generate train.jsonl and valid.jsonl files to use for fine-tuning Mistral and other LLMs.☆97Feb 5, 2024Updated 2 years ago
- FastMLX is a high performance production ready API to host MLX models.☆364Mar 18, 2025Updated last year
- A little file for doing LLM-assisted prompt expansion and image generation using Flux.schnell - complete with prompt history, prompt queu…☆26Aug 16, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- MLX Model Manager unifies loading and inferencing with LLMs and VLMs.☆102Jan 30, 2025Updated last year
- An experimental project to try how MLX Swift works☆11Jan 15, 2026Updated 6 months ago
- On-device semantic search over Apple WWDC 2025 docs using MLX embeddings — SwiftUI app (WWDC OMT 2025)☆76Jun 12, 2025Updated last year
- Tool calling using MLX Swift across iOS, macOS, and visionOS platforms☆125Jul 2, 2026Updated last month
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆103Jun 29, 2025Updated last year
- A collection of optimizers for MLX☆57Dec 12, 2025Updated 8 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆190Sep 23, 2024Updated last year
- MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.☆424May 13, 2026Updated 2 months ago
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆37Jun 21, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Repository for ACL paper: "Statements: Universal Information Extraction from Tables with Large Language Models for ESG KPIs"☆17Jul 1, 2024Updated 2 years ago
- Waffer-thin FlaskGPT on Vercel.☆12Jun 1, 2023Updated 3 years ago
- Introduction to MLX for Swift developers☆46Jun 23, 2025Updated last year
- 🧠 Retrieval Augmented Generation (RAG) example☆19Apr 17, 2026Updated 3 months ago
- Identify which embedding model produced a vector using digit-level tokenization and a tiny transformer☆22Mar 7, 2026Updated 5 months ago
- run embeddings in MLX☆97Sep 27, 2024Updated last year
- entropix style sampling + GUI☆27Oct 30, 2024Updated last year
- Skill file for MLX-Swift-LM☆24Feb 24, 2026Updated 5 months ago
- Fast parallel LLM inference for MLX☆246Jul 7, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Bypass browser bot detection in langchain tools☆20Apr 22, 2026Updated 3 months ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- ☆16Jul 31, 2026Updated last week
- vibevoice real time 0.5B swift port☆31Dec 12, 2025Updated 8 months ago
- ☆15Jun 13, 2025Updated last year
- A repo of useful MLX skills.☆87Jan 25, 2026Updated 6 months ago
- custom implementation of Karpathy's nanochat. Configured to deploy on Modal apps with a live webview. Will be a personal sandbox for twea…☆17Oct 26, 2025Updated 9 months ago
- A simple Jupyter Notebook for learning MLX text-completion fine-tuning!☆125Nov 10, 2024Updated last year
- Start a server from the MLX library.☆198Jul 26, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- MLX-powered Qwen3 embedding server for Apple Silicon Macs. Features 0.6B/4B/8B models, 44K tokens/sec throughput, REST API, batch proce…☆17Aug 9, 2025Updated last year
- 🤖 Complete reproduction of 'AlphaGo Moment for Model Architecture Discovery' using MLX-LM instead of GPT-4. Autonomous neural architectu…☆30Jul 27, 2025Updated last year
- A llama.cpp simple wrapper in Swift☆18Nov 9, 2025Updated 9 months ago
- Phi-3, -3.5, and -4 for Mac: Locally-run Vision and Language Models for Apple Silicon☆278Jul 31, 2026Updated last week
- Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.☆180Jan 31, 2024Updated 2 years ago
- [CoLM 24] Official Repository of MambaByte: Token-free Selective State Space Model☆27Oct 12, 2024Updated last year
- Nvidia Deepstream FFMPEG RTSP to HTTP Streaming☆15Sep 25, 2020Updated 5 years ago