tensorchord / modelz-ChatGLMLinks
Deploy ChatGLM on Modelz
☆15Updated 2 years ago
Alternatives and similar repositories for modelz-ChatGLM
Users that are interested in modelz-ChatGLM are comparing it to the libraries listed below
Sorting:
- 本插件是将faiss集成到greenplum数据库中,以提供向量召回的能力。☆22Updated 3 years ago
- This repository contains statistics about the AI Infrastructure products.☆18Updated 5 months ago
- Deploy and Monitor ML Model in Any Cloud☆39Updated 2 years ago
- A memory efficient DLRM training solution using ColossalAI☆105Updated 2 years ago
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆29Updated 4 months ago
- ☆35Updated 4 years ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- A collection of reproducible inference engine benchmarks☆32Updated 3 months ago
- ☆24Updated last year
- setup the env for vllm users☆16Updated last year
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 3 years ago
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- The driver for LMCache core to run in vLLM☆45Updated 6 months ago
- The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!☆18Updated last year
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22Updated 2 months ago
- fastertransformer for codegeex model☆64Updated 2 years ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆128Updated 3 weeks ago
- ☆111Updated last year
- The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes☆44Updated 3 years ago
- ☆16Updated 2 years ago
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆55Updated 8 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Updated last year
- sqlgpt-parser is a Python implementation of an SQL parser that effectively converts SQL statements into Abstract Syntax Trees (AST). By l…☆30Updated 3 months ago
- 青稞社区☆26Updated this week
- ☆30Updated 3 months ago
- Unit Minions 的各种数据准备、处理脚本,诸如 OpenAI 处理、格式转换等等。☆14Updated 2 years ago
- One-liner NebulaGraph playground with allllllllll-in-one toolchain integrated on single Linux Server☆65Updated 2 months ago
- Manages vllm-nccl dependency☆17Updated last year
- vLLM Router☆39Updated last year
- Yet another coding assistant powered by LLM.☆16Updated 10 months ago