Alternatives and similar repositories for modelz-ChatGLM

Users that are interested in modelz-ChatGLM are comparing it to the libraries listed below

• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated 4 months ago
• tensorchord / deepseek-api-arena
  A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
  ☆28Updated 3 months ago
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆105Updated 2 years ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆129Updated last week
• kemingy / vllm-env
  setup the env for vllm users
  ☆16Updated last year
• tensorchord / llmspec
  OpenAI compatible API for open source LLMs
  ☆15Updated last year
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated 2 years ago
• hpcaitech / SkyComputing
  Sky Computing: Accelerating Geo-distributed Computing in Federated Learning
  ☆91Updated 2 years ago
• allwefantasy / byzer-agent
  ☆32Updated last year
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆68Updated last year
• OrchardUniverse / litchi
  Yet another coding assistant powered by LLM.
  ☆16Updated 10 months ago
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated 2 weeks ago
• AlibabaIncubator / gpdb-faiss-vector
  本插件是将faiss集成到greenplum数据库中，以提供向量召回的能力。
  ☆22Updated 2 years ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆53Updated 8 months ago
• allwefantasy / BYZER-RETRIEVAL
  Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…
  ☆48Updated 4 months ago
• CodeGeeX / codegeex-fastertransformer
  fastertransformer for codegeex model
  ☆63Updated 2 years ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆32Updated 2 months ago
• yilinjz / astchunk
  ASTChunk is a Python toolkit for code chunking using Abstract Syntax Trees (ASTs), designed to create structurally sound and meaningful c…
  ☆30Updated 2 weeks ago
• hpcaitech / Titans
  A collection of models built with ColossalAI
  ☆32Updated 2 years ago
• ninehills / llm-playground
  Prompt 工程师利器，可同时比较多个 Prompts 在多个 LLM 模型上的效果
  ☆95Updated last year
• nebula-contrib / nebulagraph-lite
  The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!
  ☆17Updated last year
• simon-mo / vLLM-Benchmark
  ☆29Updated 2 months ago
• OpenBMB / cpm_kernels
  ☆23Updated last year
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆42Updated last year
• leptonai / examples
  Lepton Examples
  ☆141Updated last month
• tensorchord / vechord
  Turn PostgreSQL into your search engine in a Pythonic way.
  ☆47Updated this week
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆270Updated last year
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• hellangleZ / Qwen3_autothink_adapter
  Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…
  ☆21Updated 2 months ago
• 01-ai / Descartes
  ☆110Updated last year