tensorchord / modelz-ChatGLMLinks
Deploy ChatGLM on Modelz
☆16Updated 2 years ago
Alternatives and similar repositories for modelz-ChatGLM
Users that are interested in modelz-ChatGLM are comparing it to the libraries listed below
Sorting:
- This repository contains statistics about the AI Infrastructure products.☆17Updated 8 months ago
- 本插件是将faiss集成到greenplum数据库中,以提供向量召回的能力。☆24Updated 3 years ago
- ☆35Updated 4 years ago
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆30Updated 7 months ago
- A memory efficient DLRM training solution using ColossalAI☆106Updated 2 years ago
- setup the env for vllm users☆16Updated 2 years ago
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- Deploy and Monitor ML Model in Any Cloud☆39Updated 2 years ago
- Yet another coding assistant powered by LLM.☆16Updated last year
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- ☆25Updated 2 years ago
- DeepTrace: A lightweight, scalable real-time diagnostic and analysis tool for distributed training tasks.☆17Updated last week
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆131Updated last month
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Updated 3 years ago
- Prompt 工程师利器,可同时比较多个 Prompts 在多个 LLM 模型上的效果☆96Updated 2 years ago
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22Updated 6 months ago
- The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes☆44Updated 4 years ago
- ☆112Updated last year
- Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…☆49Updated 8 months ago
- A collection of reproducible inference engine benchmarks☆37Updated 6 months ago
- The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!☆19Updated last year
- ☆31Updated 6 months ago
- The driver for LMCache core to run in vLLM☆56Updated 9 months ago
- Manages vllm-nccl dependency☆17Updated last year
- Turn PostgreSQL into your search engine in a Pythonic way.☆51Updated 2 months ago
- 滴滴云推理服务的 HTTP 客户端示例代码☆21Updated 2 years ago
- Workflow Defined Engine☆24Updated last week
- ☆21Updated 3 months ago
- Material for Ray Connect 2024 Conference☆12Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Updated last year