OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
☆273Oct 11, 2023Updated 3 years ago
Alternatives and similar repositories for modelz-llm
Users that are interested in modelz-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆283Nov 3, 2023Updated 2 years ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Jun 28, 2023Updated 3 years ago
- A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine☆902Oct 2, 2026Updated last week
- Hey, Agent! 🐝 The bees are watching you! 🐝☆18Oct 2, 2026Updated last week
- fsspec filesystem backed by Apache OpenDAL.☆39Aug 28, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- DataFusion Playground with WASM☆14Apr 8, 2024Updated 2 years ago
- A bridge between different serde implementations.☆16Sep 8, 2025Updated last year
- Custom Scheduler to deploy ML models to TRTIS for GPU Sharing☆12Apr 1, 2020Updated 6 years ago
- The Databend plugin for dbt (data build tool)☆12Mar 17, 2023Updated 3 years ago
- OSPP 2022 Project: String Adaptive Hash Table for Databend☆19Sep 15, 2022Updated 4 years ago
- NVIDIA device plugin for Kubernetes☆15Sep 9, 2019Updated 7 years ago
- Jittor code for APDrawingGAN: Generating Artistic Portrait Drawings from Face Photos with Hierarchical GANs (CVPR 2019 Oral)☆13Apr 13, 2021Updated 5 years ago
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆12,557Updated this week
- QDrant docker-compose deployment with basic auth/nginx proxy☆23Apr 12, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, X…☆2,459Sep 26, 2024Updated 2 years ago
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Sep 26, 2023Updated 3 years ago
- A Next.js chatbot app demonstrating seamless integration with window.ai.☆16Jun 25, 2023Updated 3 years ago
- MOTIF: Modular Thinking via Reinforcement Fine-tuning in LLMs☆17Jul 6, 2025Updated last year
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,552May 1, 2026Updated 5 months ago
- An awesome & curated list of best LLMOps tools for developers☆5,958Oct 5, 2026Updated last week
- API definitions for the crane project☆20Jul 23, 2025Updated last year
- Workflow Defined Engine☆25Nov 4, 2025Updated 11 months ago
- Extensible backend of software mirror☆30Sep 14, 2026Updated 3 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- multi-master-paxos with 3 nodes☆14Apr 11, 2022Updated 4 years ago
- ☆12Updated this week
- a simple programming language under development☆11Dec 3, 2023Updated 2 years ago
- ☆16Jan 23, 2025Updated last year
- 🏕️ Reproducible development environment for humans and agents☆2,237Oct 2, 2026Updated last week
- Quick & Dirty cli to process mysql dumps☆10Sep 30, 2022Updated 4 years ago
- JSONB implement in rust☆88Sep 2, 2026Updated last month
- ☆15Jul 18, 2023Updated 3 years ago
- Rust bindings for Kubernetes Container Storage Interface generated from Protobuf using Tonic/Prost☆15Aug 4, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.☆2,190Feb 26, 2025Updated last year
- OpenAI compatible API for open source LLMs☆16Oct 30, 2023Updated 2 years ago
- The Bytepiece Tokenizer Implemented in Rust.☆15Nov 28, 2023Updated 2 years ago
- AskBend: SQL-based Knowledge Base Search and Completion using Databend☆186Dec 29, 2023Updated 2 years ago
- Evaluation code of ASE24 accepted paper "On the Evaluation of LLM in Unit Test Generation"☆13Dec 9, 2024Updated last year
- TPCH benchmark tool for databend☆11Nov 15, 2022Updated 3 years ago
- Provide OpenAI style API for ChatGLM-6B and Chinese Embeddings Model☆503Jul 20, 2023Updated 3 years ago