tensorchord / modelz-ChatGLMLinks
Deploy ChatGLM on Modelz
☆16Updated 2 years ago
Alternatives and similar repositories for modelz-ChatGLM
Users that are interested in modelz-ChatGLM are comparing it to the libraries listed below
Sorting:
- This repository contains statistics about the AI Infrastructure products.☆17Updated 11 months ago
- 本插件是将faiss集成到greenplum数据库中,以提供向量召回的能力。☆24Updated 3 years ago
- A memory efficient DLRM training solution using ColossalAI☆105Updated 3 years ago
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆30Updated 10 months ago
- ☆25Updated 2 years ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- setup the env for vllm users☆16Updated 2 years ago
- ☆35Updated 4 years ago
- Some microbenchmarks and design docs before commencement☆12Updated 5 years ago
- Manages vllm-nccl dependency☆17Updated last year
- Prompt 工程师利器,可同时比较多个 Prompts 在多个 LLM 模型上的效果☆96Updated 2 years ago
- ☆79Updated 2 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Updated 3 years ago
- Deploy and Monitor ML Model in Any Cloud☆39Updated 3 years ago
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆91Updated last year
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆131Updated 4 months ago
- Yet another coding assistant powered by LLM.☆16Updated last year
- 滴滴云推理服务的 HTTP 客户端示例代码☆21Updated 3 years ago
- Evaluation for AI apps and agent☆44Updated 2 years ago
- ☆31Updated 9 months ago
- Transformer related optimization, including BERT, GPT☆17Updated 2 years ago
- A collection of reproducible inference engine benchmarks☆38Updated 9 months ago
- ☆32Updated last year
- Gaokao Benchmark for AI☆109Updated 3 years ago
- 百度QA100万数据集☆46Updated 2 years ago
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22Updated 8 months ago
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆251Updated last year
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆68Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Updated last year
- Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…☆49Updated 10 months ago