tensorchord / openmodelz
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).
☆239Updated last year
Related projects ⓘ
Alternatives and complementary repositories for openmodelz
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)☆265Updated last year
- ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…☆155Updated this week
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆129Updated 3 weeks ago
- A diverse, simple, and secure all-in-one LLMOps platform☆85Updated last month
- https://TiDB.AI is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage and LlamaIndex. Ope…☆199Updated this week
- Open-source observability for your LLM application.☆43Updated 2 weeks ago
- A lightweight version of Milvus☆276Updated 2 weeks ago
- EvalGPT is an code interpreter framework that utilizes large language models to automate the process of code-writing and execution, deliv…☆250Updated last year
- Self-hosted huggingface mirror service.☆76Updated this week
- Turn any OCR models into online inference API endpoint 🚀 🌖☆50Updated last year
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆53Updated 7 months ago
- an MLOps/LLMOps platform☆208Updated 3 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆101Updated last week
- 📚 This is an adapted version of Jina AI's Reader for local deployment using Docker. Convert any URL to an LLM-friendly input with a simp…☆46Updated last month
- Examples on how to use LangChain and Ray☆220Updated last year
- Self-host LLMs with vLLM and BentoML☆72Updated this week
- ☆205Updated this week
- Octogen is an Open-Source Code Interpreter Agent Framework☆253Updated 3 months ago
- ☆32Updated 9 months ago
- 🎉 An awesome & curated list of best LLMOps tools.☆29Updated 3 weeks ago
- Model Deployment at Scale on Kubernetes 🦄️☆789Updated 6 months ago
- Open Source Text Embedding Models with OpenAI Compatible API☆131Updated 3 months ago
- Python client library for improving your LLM app accuracy☆96Updated this week
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆49Updated 2 months ago
- 🎧 Pod-Helper: Real-time audio transcription and repair on consumer hardware☆78Updated 8 months ago
- Manage GPU clusters for running LLMs☆551Updated this week
- Develop, evaluate and monitor LLM applications at scale☆93Updated this week
- LLMPerf is a library for validating and benchmarking LLMs☆636Updated 2 months ago
- Redis Vector Library (RedisVL) interfaces with Redis' vector database for realtime semantic search, RAG, and recommendation systems.☆229Updated this week
- VQLite - Simple and Lightweight Vector Search Engine based on Google ScaNN☆84Updated 3 months ago