tensorchord / modelz-ChatGLMLinks
Deploy ChatGLM on Modelz
☆16Updated 2 years ago
Alternatives and similar repositories for modelz-ChatGLM
Users that are interested in modelz-ChatGLM are comparing it to the libraries listed below
Sorting:
- This repository contains statistics about the AI Infrastructure products.☆17Updated 10 months ago
- 本插件是将faiss集成到greenplum数据库中,以提供向量召回的能力。☆24Updated 3 years ago
- A memory efficient DLRM training solution using ColossalAI☆105Updated 3 years ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- ☆35Updated 4 years ago
- Deploy and Monitor ML Model in Any Cloud☆39Updated 3 years ago
- setup the env for vllm users☆16Updated 2 years ago
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆30Updated 9 months ago
- Manages vllm-nccl dependency☆17Updated last year
- Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…☆49Updated 10 months ago
- ☆25Updated 2 years ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆131Updated 3 months ago
- A collection of reproducible inference engine benchmarks☆38Updated 8 months ago
- 百度QA100万数据集☆46Updated 2 years ago
- Prompt 工程师利器,可同时比较多个 Prompts 在多个 LLM 模型上的效果☆96Updated 2 years ago
- ☆32Updated last year
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- fastertransformer for codegeex model☆65Updated 2 years ago
- ☆114Updated last year
- Yet another coding assistant powered by LLM.☆16Updated last year
- ☆16Updated 3 years ago
- Material for Ray Connect 2024 Conference☆12Updated last year
- ☆79Updated 2 years ago
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆90Updated last year
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22Updated 8 months ago
- Service for Bert model to Vector. 高效的文本转向量(Text-To-Vector)服务,支持GPU多卡、多worker、多客户端调用,开箱即用。☆12Updated 3 years ago
- ☆23Updated 2 years ago
- 2019算法大赛-pv/uv流量预测和Session分析☆14Updated 2 years ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆78Updated last year
- Another ChatGLM2 implementation for GPTQ quantization☆54Updated 2 years ago