leptonai / examplesLinks
Lepton Examples
☆146Updated last month
Alternatives and similar repositories for examples
Users that are interested in examples are comparing it to the libraries listed below
Sorting:
- Efficient AI Inference & Serving☆478Updated last year
- LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.☆164Updated 6 months ago
- AI for all: Build the large graph of the language models☆277Updated last year
- The next generation of Multi-Modal Multi-Agent platform.☆109Updated 6 months ago
- A high-performance inference system for large language models, designed for production environments.☆488Updated last month
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆250Updated last year
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆278Updated 2 years ago
- ☆66Updated last year
- ☆74Updated last year
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆130Updated 2 months ago
- Inference code for Mistral and Mixtral hacked up into original Llama implementation☆371Updated 2 years ago
- 👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.☆360Updated 10 months ago
- Prompt 工程师利器，可同时比较多个 Prompts 在多个 LLM 模型上的效果☆97Updated 2 years ago
- Benchmarking suite for popular AI APIs☆88Updated 10 months ago
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)☆275Updated 2 years ago
- Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower exe…☆264Updated 6 months ago
- A third-party component library based on Gradio. Integrates Ant Design, Ant Design X, Monaco Editor and more advanced components to help…☆132Updated 3 weeks ago
- Data preparation code for Amber 7B LLM☆93Updated last year
- GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well a…☆346Updated last year
- NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…☆318Updated 2 years ago
- Mixture-of-Experts (MoE) Language Model☆192Updated last year
- Self-host LLMs with LMDeploy and BentoML☆21Updated 5 months ago
- Social and customizable AI writing assistant! ✍️☆258Updated 5 months ago
- Langchain implementation of HuggingGPT☆134Updated 2 years ago
- [ICLR 2025] A trinity of environments, tools, and benchmarks for general virtual agents☆219Updated 5 months ago
- Develop, evaluate and monitor LLM applications at scale☆98Updated last year
- A curated list of autonomous agents and developer tools powered by LLM.☆42Updated 2 years ago
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆57Updated last year
- ☆133Updated 2 years ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆137Updated last year