Alternatives and similar repositories for modelz-ChatGLM:

Users that are interested in modelz-ChatGLM are comparing it to the libraries listed below

• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated 2 months ago
• tensorchord / deepseek-api-arena
  A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
  ☆29Updated last month
• kemingy / vllm-env
  setup the env for vllm users
  ☆16Updated last year
• nebula-contrib / nebulagraph-lite
  The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!
  ☆17Updated 11 months ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• allwefantasy / byzer-agent
  ☆32Updated last year
• AlibabaIncubator / gpdb-faiss-vector
  本插件是将faiss集成到greenplum数据库中，以提供向量召回的能力。
  ☆22Updated 2 years ago
• allwefantasy / BYZER-RETRIEVAL
  Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…
  ☆48Updated 2 months ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆29Updated 2 weeks ago
• OrchardUniverse / litchi
  Yet another coding assistant powered by LLM.
  ☆16Updated 7 months ago
• tensorchord / llmspec
  OpenAI compatible API for open source LLMs
  ☆15Updated last year
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆37Updated last year
• CodeGeeX / codegeex-fastertransformer
  fastertransformer for codegeex model
  ☆63Updated last year
• unit-mesh / minions-data-prepare
  Unit Minions 的各种数据准备、处理脚本，诸如 OpenAI 处理、格式转换等等。
  ☆14Updated 2 years ago
• bentoml / llm-bench
  ☆50Updated 5 months ago
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆104Updated 2 years ago
• simon-mo / vLLM-Benchmark
  ☆25Updated 2 weeks ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆38Updated 3 months ago
• zijie0 / cloud_ml_platform
  ☆35Updated 3 years ago
• OpenBMB / cpm_kernels
  ☆23Updated last year
• tensorchord / envd-server
  Backend server for envd
  ☆20Updated last year
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆41Updated last year
• cpldcpu / llmbenchmark
  Various LLM Benchmarks
  ☆19Updated 3 weeks ago
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• wey-gu / nebulagraph-ai
  (Pre Alpha)NebulaGraph AI High-Level API, do Graph Algo, Analytics in 4 lines of code.
  ☆77Updated 8 months ago
• Yard1 / Ray-DeepSpeed-Inference
  ☆17Updated 2 years ago
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated 11 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆65Updated last year
• 01-ai / Descartes
  ☆108Updated last year