leptonai / examplesLinks
Lepton Examples
☆145Updated 3 weeks ago
Alternatives and similar repositories for examples
Users that are interested in examples are comparing it to the libraries listed below
Sorting:
- Efficient AI Inference & Serving☆477Updated last year
- LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.☆164Updated 3 months ago
- A high-performance inference system for large language models, designed for production environments.☆466Updated last week
- ☆74Updated last year
- AI for all: Build the large graph of the language models☆275Updated last year
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆132Updated this week
- The next generation of Multi-Modal Multi-Agent platform.☆105Updated 4 months ago
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆248Updated last year
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆274Updated last year
- ☆66Updated last year
- Benchmarking suite for popular AI APIs☆88Updated 7 months ago
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆56Updated last year
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)☆276Updated last year
- Inference code for Mistral and Mixtral hacked up into original Llama implementation☆370Updated last year
- A curated list of autonomous agents and developer tools powered by LLM.☆40Updated last year
- ☆64Updated last week
- AGI模块库架构图☆77Updated 2 years ago
- 👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.☆354Updated 7 months ago
- Complex question answering in LLMs with enhanced reasoning and information-seeking capabilities.☆201Updated last year
- an MLOps/LLMOps platform☆234Updated 9 months ago
- GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well a…☆347Updated last year
- Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower exe…☆253Updated 4 months ago
- ☆469Updated last year
- An open-source LLM tool for extracting repeatable tasks from your conversations, and saving them into a customized skill library for retr…☆128Updated last year
- Langchain implementation of HuggingGPT☆133Updated 2 years ago
- LLM Group Chat Framework: chat with multiple LLMs at the same time. 大模型群聊框架：同时与多个大语言模型聊天。☆321Updated 3 months ago
- ☆252Updated last year
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆86Updated last year
- NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…☆317Updated last year
- Mixture-of-Experts (MoE) Language Model☆190Updated last year