leptonai / examplesLinks
Lepton Examples
☆145Updated 3 weeks ago
Alternatives and similar repositories for examples
Users that are interested in examples are comparing it to the libraries listed below
Sorting:
- Efficient AI Inference & Serving☆477Updated last year
- A high-performance inference system for large language models, designed for production environments.☆463Updated last month
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆272Updated last year
- AI for all: Build the large graph of the language models☆274Updated last year
- Benchmarking suite for popular AI APIs☆88Updated 6 months ago
- LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.☆164Updated 3 months ago
- The next generation of Multi-Modal Multi-Agent platform.☆106Updated 3 months ago
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆247Updated last year
- Langchain implementation of HuggingGPT☆133Updated 2 years ago
- Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower exe…☆251Updated 3 months ago
- ☆64Updated this week
- 👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.☆353Updated 7 months ago
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆86Updated last year
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆56Updated last year
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)☆276Updated last year
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆129Updated 3 weeks ago
- ☆251Updated last year
- ☆65Updated last year
- ☆467Updated last year
- A Survey of AI startups☆401Updated 2 years ago
- Social and customizable AI writing assistant! ✍️☆253Updated 2 months ago
- A third-party component library based on Gradio. Integrates Ant Design, Ant Design X, and more advanced components to help you build appl…☆115Updated last week
- Self-host LLMs with LMDeploy and BentoML☆22Updated last month
- Akcio is a demonstration project for Retrieval Augmented Generation (RAG). It leverages the power of LLM to generate responses and uses v…☆260Updated last year
- Mixture-of-Experts (MoE) Language Model☆189Updated 11 months ago
- ☆132Updated last year
- Inference code for Mistral and Mixtral hacked up into original Llama implementation☆371Updated last year
- ☆75Updated last year
- Receipts for creating AI Applications with APIs from DashScope (and friends)!☆62Updated 11 months ago
- AGI模块库架构图☆76Updated 2 years ago