OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
☆273Oct 11, 2023Updated 3 years ago
Alternatives and similar repositories for modelz-llm
Users that are interested in modelz-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆282Nov 3, 2023Updated 3 years ago
- A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine☆903Updated this week
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Jun 28, 2023Updated 3 years ago
- Hey, Agent! 🐝 The bees are watching you! 🐝☆18Updated this week
- A bridge between different serde implementations.☆16Sep 8, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- DataFusion Playground with WASM☆14Apr 8, 2024Updated 2 years ago
- The Databend plugin for dbt (data build tool)☆12Mar 17, 2023Updated 3 years ago
- Kubectl plugin for crane, including recommendation and cost estimate.☆15Apr 24, 2023Updated 3 years ago
- fsspec filesystem backed by Apache OpenDAL.☆39Aug 28, 2026Updated 2 months ago
- Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, X…☆2,458Sep 26, 2024Updated 2 years ago
- Custom Scheduler to deploy ML models to TRTIS for GPU Sharing☆12Apr 1, 2020Updated 6 years ago
- 🏕️ Reproducible development environment for humans and agents☆2,242Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆12,582Updated this week
- A CoreDNS plugin to create records for Kubernetes nodes.☆13Apr 4, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆16May 31, 2024Updated 2 years ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,548May 1, 2026Updated 6 months ago
- Model Context Protocol Server for Apache OpenDAL™☆35Apr 10, 2025Updated last year
- ☆19Apr 11, 2024Updated 2 years ago
- An awesome & curated list of best LLMOps tools for developers☆5,971Oct 16, 2026Updated 3 weeks ago
- 我陈平安，唯有一键，可搬山，倒海，降妖，镇魔，敕神，摘星，断江，摧城，开天！☆22Jun 4, 2022Updated 4 years ago
- Turn PostgreSQL into your search engine in a Pythonic way.☆52Aug 29, 2025Updated last year
- ☆12Oct 20, 2022Updated 4 years ago
- Apache OpenDAL Go Binding Services Releases☆16Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.☆203Mar 24, 2022Updated 4 years ago
- MOTIF: Modular Thinking via Reinforcement Fine-tuning in LLMs☆17Jul 6, 2025Updated last year
- Your AI Kubernetes Expert☆186Apr 6, 2023Updated 3 years ago
- Run any Large Language Model behind a unified API☆169Nov 13, 2023Updated 2 years ago
- Batch-scheduler based on K8s scheduling framework, related features have contributed to scheduler-plugins(Deprecated).☆26Aug 6, 2020Updated 6 years ago
- A Next.js chatbot app demonstrating seamless integration with window.ai.☆16Jun 25, 2023Updated 3 years ago
- Extensible backend of software mirror☆30Sep 14, 2026Updated last month
- A slab allocator with stable references☆15Jan 23, 2023Updated 3 years ago
- A Javascript library that discourages and prevents image theft/download by preventing client ability to retrieve the image.☆13Sep 18, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Bindings to HDFS Native C API.☆14Oct 26, 2026Updated last week
- API definitions for the crane project☆20Jul 23, 2025Updated last year
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Sep 26, 2023Updated 3 years ago
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆27Apr 24, 2025Updated last year
- A telegram bot for OpenAI API☆30May 8, 2025Updated last year
- Stock analysis MLOps system based on DolphinScheduler☆12Oct 19, 2022Updated 4 years ago
- Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.☆2,191Feb 26, 2025Updated last year