leptonai / leptonaiView external linksLinks
A Pythonic framework to simplify AI service building
☆2,806Jan 31, 2026Updated 2 weeks ago
Alternatives and similar repositories for leptonai
Users that are interested in leptonai are comparing it to the libraries listed below
Sorting:
- Building a quick conversation-based search demo with Lepton AI.☆8,121Dec 2, 2025Updated 2 months ago
- A series of large language models trained from scratch by developers @01-ai☆7,844Nov 27, 2024Updated last year
- SGLang is a high-performance serving framework for large language models and multimodal models.☆23,547Updated this week
- Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.☆11,021Feb 8, 2026Updated last week
- Universal memory layer for AI Agents☆47,230Feb 3, 2026Updated 2 weeks ago
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆46,977Updated this week
- High-speed Large Language Model Serving for Local Deployment☆8,671Jan 24, 2026Updated 3 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆70,205Updated this week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆41,627Updated this week
- Perplexity Inspired Answer Engine☆5,017Jun 27, 2025Updated 7 months ago
- Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""☆3,920Nov 25, 2024Updated last year
- Question and Answer based on Anything.☆13,859Mar 24, 2025Updated 10 months ago
- MiniCPM4 & MiniCPM4.1: Ultra-Efficient LLMs on End Devices, achieving 3+ generation speedup on reasoning tasks☆8,606Updated this week
- Large World Model -- Modeling Text and Video with Millions Context☆7,396Oct 19, 2024Updated last year
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆12,102Feb 9, 2026Updated last week
- Making large AI models cheaper, faster and more accessible☆41,346Jan 19, 2026Updated 3 weeks ago
- Modeling, training, eval, and inference code for OLMo☆6,306Nov 24, 2025Updated 2 months ago
- LMDeploy is a toolkit for compressing, deploying, and serving LLMs.☆7,606Updated this week
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆35,968Updated this week
- Letta is the platform for building stateful agents: AI with advanced memory that can learn and self-improve over time.☆21,125Jan 29, 2026Updated 2 weeks ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,402Jun 2, 2025Updated 8 months ago
- Universal LLM Deployment Engine with ML Compilation☆22,039Updated this week
- [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild☆4,703Nov 18, 2024Updated last year
- Large Language Model Text Generation Inference☆10,769Jan 8, 2026Updated last month
- Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).☆7,157Oct 30, 2025Updated 3 months ago
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆7,188Jul 11, 2024Updated last year
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆10,614Jan 26, 2026Updated 3 weeks ago
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,928Jul 11, 2025Updated 7 months ago
- Inference code for CodeLlama models☆16,355Aug 12, 2024Updated last year
- AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents☆18,131Updated this week
- The first "code-first" agent framework for seamlessly planning and executing data analytics tasks.☆6,113Feb 3, 2026Updated 2 weeks ago
- The programming language for agentic software.☆37,873Updated this week
- ☆6,754Jun 26, 2025Updated 7 months ago
- Build ChatGPT over your data, all with natural language☆6,535Apr 5, 2024Updated last year
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…☆12,867Updated this week
- A programming framework for agentic AI☆54,550Jan 22, 2026Updated 3 weeks ago
- An Autonomous LLM Agent for Complex Task Solving☆8,496Aug 12, 2024Updated last year
- Fabric is an open-source framework for augmenting humans using AI. It provides a modular system for solving specific problems using a cro…☆39,051Updated this week
- An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents☆5,863Sep 26, 2024Updated last year