bentoml / OpenLLMLinks
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
☆11,933Updated last week
Alternatives and similar repositories for OpenLLM
Users that are interested in OpenLLM are comparing it to the libraries listed below
Sorting:
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆45,244Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,545Updated last week
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,826Updated 4 months ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,250Updated 5 months ago
- Large Language Model Text Generation Inference☆10,643Updated last week
- Universal LLM Deployment Engine with ML Compilation☆21,619Updated this week
- Open source codebase powering the HuggingChat app☆10,260Updated this week
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆13,223Updated this week
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,456Updated 5 months ago
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,524Updated 2 years ago
- Numbers every LLM developer should know☆4,266Updated last year
- ☆21,933Updated last year
- Build AI Agents, Visually☆46,513Updated this week
- A guidance language for controlling large language models.☆20,911Updated last month
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆5,280Updated this week
- Build Conversational AI in minutes ⚡️☆10,995Updated this week
- A programming framework for agentic AI☆51,759Updated last month
- Open-source search and retrieval database for AI applications.☆24,388Updated this week
- High-performance In-browser LLM Inference Engine☆16,778Updated 2 weeks ago
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,479Updated last year
- 📋 A list of open LLMs available for commercial use.☆12,509Updated 9 months ago
- Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.☆19,139Updated this week
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,832Updated last year
- Home of StarCoder: fine-tuning & inference!☆7,472Updated last year
- 😎 Awesome list of tools and projects with the awesome LangChain framework☆8,930Updated 3 weeks ago
- H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/☆4,716Updated last month
- ☆6,150Updated last month
- LLM as a Chatbot Service☆3,340Updated last year
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆18,033Updated 2 weeks ago
- Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.☆10,864Updated 2 weeks ago