Alternatives and similar repositories for modelz-ChatGLM:

Users that are interested in modelz-ChatGLM are comparing it to the libraries listed below

• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated last week
• kemingy / vllm-env
  setup the env for vllm users
  ☆16Updated last year
• allwefantasy / BYZER-RETRIEVAL
  Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…
  ☆47Updated this week
• nebula-contrib / nebulagraph-lite
  The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!
  ☆16Updated 9 months ago
• allwefantasy / byzer-agent
  ☆31Updated 11 months ago
• AlibabaIncubator / gpdb-faiss-vector
  本插件是将faiss集成到greenplum数据库中，以提供向量召回的能力。
  ☆21Updated 2 years ago
• unit-mesh / minions-data-prepare
  Unit Minions 的各种数据准备、处理脚本，诸如 OpenAI 处理、格式转换等等。
  ☆14Updated last year
• tensorchord / llmspec
  OpenAI compatible API for open source LLMs
  ☆15Updated last year
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• OpenBMB / cpm_kernels
  ☆23Updated last year
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆32Updated last month
• zijie0 / cloud_ml_platform
  ☆35Updated 3 years ago
• OrchardUniverse / litchi
  Yet another coding assistant powered by LLM.
  ☆15Updated 5 months ago
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆103Updated 2 years ago
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆92Updated 11 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆63Updated 11 months ago
• tensorchord / qtext
  ☆18Updated 11 months ago
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆117Updated 2 weeks ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆40Updated 4 months ago
• CodeGeeX / codegeex-fastertransformer
  fastertransformer for codegeex model
  ☆63Updated last year
• banburytang / List-of-Chinese-Open-Source-Project-Financing
  ☆16Updated 2 years ago
• eosphoros-ai / sqlgpt-parser
  sqlgpt-parser is a Python implementation of an SQL parser that effectively converts SQL statements into Abstract Syntax Trees (AST). By l…
  ☆28Updated last year
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆36Updated last year
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆56Updated last year
• Yard1 / Ray-DeepSpeed-Inference
  ☆17Updated last year
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆36Updated last year
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 4 years ago
• modelize-ai / LLM-Inference-Deployment-Tutorial
  Tutorial for LLM developers about engine design, service deployment, evaluation/benchmark, etc. Provide a C/S style optimized LLM inferen…
  ☆19Updated last year