tensorchord / modelz-ChatGLMLinks
Deploy ChatGLM on Modelz
☆16Updated 2 years ago
Alternatives and similar repositories for modelz-ChatGLM
Users that are interested in modelz-ChatGLM are comparing it to the libraries listed below
Sorting:
- 本插件是将faiss集成到greenplum数据库中,以提供向量召回的能力。☆23Updated 3 years ago
- This repository contains statistics about the AI Infrastructure products.☆17Updated 7 months ago
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆29Updated 6 months ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- A memory efficient DLRM training solution using ColossalAI☆106Updated 2 years ago
- Yet another coding assistant powered by LLM.☆16Updated last year
- ☆35Updated 4 years ago
- Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…☆49Updated 7 months ago
- setup the env for vllm users☆16Updated last year
- ☆25Updated 2 years ago
- Prompt 工程师利器,可同时比较多个 Prompts 在多个 LLM 模型上的效果☆96Updated 2 years ago
- Deploy and Monitor ML Model in Any Cloud☆39Updated 2 years ago
- Manages vllm-nccl dependency☆17Updated last year
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- ☆112Updated last year
- A collection of reproducible inference engine benchmarks☆34Updated 6 months ago
- Evaluation for AI apps and agent☆43Updated last year
- Service for Bert model to Vector. 高效的文本转向量(Text-To-Vector)服务,支持GPU多卡、多worker、多客户端调用,开箱即用。☆12Updated 3 years ago
- Material for Ray Connect 2024 Conference☆12Updated last year
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆58Updated 11 months ago
- The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!☆19Updated last year
- 百度QA100万数据集☆48Updated last year
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆131Updated last month
- 总结如何更好地集成 ChatGPT 的相关模式,方便于我们后续在其它 LLM(大语言模型)中使用。Summary some interesting integration modes related to ChatGPT, which will facilitate our…☆71Updated 2 years ago
- sqlgpt-parser is a Python implementation of an SQL parser that effectively converts SQL statements into Abstract Syntax Trees (AST). By l…☆33Updated 6 months ago
- ☆32Updated last year
- The driver for LMCache core to run in vLLM☆54Updated 8 months ago
- DeepTrace: A lightweight, scalable real-time diagnostic and analysis tool for distributed training tasks.☆16Updated last month
- Large-scale exact string matching tool☆17Updated 7 months ago
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22Updated 5 months ago