tensorchord / openmodelzLinks
Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
☆278Updated 2 years ago
Alternatives and similar repositories for openmodelz
Users that are interested in openmodelz are comparing it to the libraries listed below
Sorting:
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)☆275Updated 2 years ago
- EvalGPT is an code interpreter framework that utilizes large language models to automate the process of code-writing and execution, deliv…☆249Updated 2 years ago
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆151Updated last year
- A diverse, simple, and secure all-in-one LLMOps platform☆109Updated last year
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆57Updated last year
- Turn any OCR models into online inference API endpoint 🚀 🌖☆57Updated last month
- Open-source observability for your LLM application.☆53Updated 11 months ago
- an MLOps/LLMOps platform☆233Updated last year
- Benchmarking suite for popular AI APIs☆88Updated 10 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆131Updated 3 months ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆78Updated last year
- An open-source cloud-native of large multi-modal models (LMMs) serving framework.☆164Updated 2 years ago
- Self-host LLMs with vLLM and BentoML☆162Updated last month
- Examples on how to use LangChain and Ray☆232Updated 2 years ago
- ☆66Updated 8 months ago
- Octogen is an Open-Source Code Interpreter Agent Framework☆257Updated last year
- Develop, evaluate and monitor LLM applications at scale☆98Updated last year
- Turn PostgreSQL into your search engine in a Pythonic way.☆50Updated 3 months ago
- ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…☆177Updated last year
- setup the env for vllm users☆16Updated 2 years ago
- Python client library for improving your LLM app accuracy☆97Updated 10 months ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- This repository contains statistics about the AI Infrastructure products.☆17Updated 9 months ago
- Open Source Text Embedding Models with OpenAI Compatible API☆164Updated last year
- ☆474Updated last year
- A tool for generating function arguments and choosing what function to call with local LLMs☆433Updated last year
- Lepton Examples☆146Updated last month
- Self-hosted huggingface mirror service. 自建huggingface镜像服务。☆209Updated 5 months ago
- FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)☆246Updated last year
- Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.☆57Updated last year