tensorchord / modelz-ChatGLM
Deploy ChatGLM on Modelz
☆15Updated last year
Alternatives and similar repositories for modelz-ChatGLM:
Users that are interested in modelz-ChatGLM are comparing it to the libraries listed below
- This repository contains statistics about the AI Infrastructure products.☆18Updated 3 weeks ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated last year
- ☆31Updated 11 months ago
- setup the env for vllm users☆16Updated last year
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆62Updated 10 months ago
- The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!☆16Updated 8 months ago
- OpenAI compatible API for open source LLMs☆15Updated last year
- The driver for LMCache core to run in vLLM☆28Updated 2 weeks ago
- 本插件是将faiss集成到greenplum数据库中,以提供向量召回的能力。☆21Updated 2 years ago
- Sentence Embedding as a Service☆14Updated last year
- A library integrating embedding and reranker models from OpenAI, SentenceTransformers etc for semantic search in vector database.☆32Updated this week
- A memory efficient DLRM training solution using ColossalAI☆101Updated 2 years ago
- ☆35Updated 3 years ago
- Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…☆45Updated last month
- Yet another coding assistant powered by LLM.☆14Updated 5 months ago
- Evaluation for AI apps and agent☆36Updated last year
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆93Updated 11 months ago
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆36Updated last year
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆112Updated last week
- ☆18Updated 10 months ago
- 🎉 An awesome & curated list of best LLMOps tools.☆40Updated last week
- sqlgpt-parser is a Python implementation of an SQL parser that effectively converts SQL statements into Abstract Syntax Trees (AST). By l…☆28Updated last year
- Benchmark suite for LLMs from Fireworks.ai☆66Updated last week
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- ☆23Updated last year
- Unit Minions 的各种数据准备、处理脚本,诸如 OpenAI 处理、格式转换等等。☆14Updated last year
- Nexusflow function call, tool use, and agent benchmarks.☆19Updated 2 months ago
- fastertransformer for codegeex model☆64Updated last year
- ☆69Updated 3 weeks ago
- ☆107Updated 10 months ago