bentoml / OpenLLMLinks
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
☆12,034Updated 3 weeks ago
Alternatives and similar repositories for OpenLLM
Users that are interested in OpenLLM are comparing it to the libraries listed below
Sorting:
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,677Updated 2 weeks ago
- Large Language Model Text Generation Inference☆10,728Updated last week
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, o…☆9,215Updated this week
- The open source codebase powering HuggingChat☆10,420Updated last week
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,901Updated 6 months ago
- A guidance language for controlling large language models.☆21,157Updated last week
- 😎 Awesome list of tools and projects with the awesome LangChain framework☆9,098Updated last week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆46,355Updated this week
- Build Conversational AI in minutes ⚡️☆11,364Updated this week
- ☆22,071Updated last year
- Open-source search and retrieval database for AI applications.☆25,450Updated this week
- Instruct-tune LLaMA on consumer hardware☆18,989Updated last year
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,525Updated 2 years ago
- Python bindings for llama.cpp☆9,901Updated 5 months ago
- Universal LLM Deployment Engine with ML Compilation☆21,859Updated 2 weeks ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,805Updated last year
- High-performance In-browser LLM Inference Engine☆17,107Updated last month
- OpenChat: Advancing Open-source Language Models with Imperfect Data☆5,468Updated last year
- StableLM: Stability AI Language Models☆15,775Updated last year
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,871Updated last year
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,475Updated 7 months ago
- Inference code for CodeLlama models☆16,360Updated last year
- Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cl…☆28,221Updated this week
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,755Updated 2 months ago
- ☆6,223Updated 2 weeks ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,357Updated 7 months ago
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,483Updated last year
- A programming framework for agentic AI☆53,353Updated 3 months ago
- H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/☆4,769Updated this week
- Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.☆20,619Updated this week