Alternatives and similar repositories for EnergonAI:

Users that are interested in EnergonAI are comparing it to the libraries listed below

• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆562Updated 5 months ago
• triton-inference-server / fastertransformer_backend
  ☆411Updated last year
• hpcaitech / ColossalAI-Examples
  Examples of training models with hybrid parallelism using ColossalAI
  ☆338Updated 2 years ago
• volcengine / veGiantModel
  ☆214Updated last year
• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆191Updated 2 years ago
• Azure / MS-AMP
  Microsoft Automatic Mixed Precision Library
  ☆581Updated 5 months ago
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆397Updated 2 months ago
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆580Updated 8 months ago
• Vahe1994 / SpQR
  ☆542Updated 3 months ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,378Updated last year
• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆468Updated last year
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆471Updated last year
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆298Updated last year
• bytedance / effective_transformer
  Running BERT without Padding
  ☆472Updated 3 years ago
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆267Updated last year
• bigscience-workshop / xmtf
  Crosslingual Generalization through Multitask Finetuning
  ☆529Updated 6 months ago
• OpenBMB / BMInf
  Efficient Inference for Big Models
  ☆580Updated 2 years ago
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆645Updated last year
• deepspeedai / DeepSpeed-MII
  MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
  ☆1,990Updated this week
• bigscience-workshop / bigscience
  Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
  ☆989Updated 7 months ago
• SqueezeAILab / SqueezeLLM
  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
  ☆680Updated 7 months ago
• Tencent / PatrickStar
  PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.
  ☆757Updated last year
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆103Updated 2 years ago
• OpenPPL / ppl.llm.serving
  ☆127Updated 3 months ago
• anyscale / llm-continuous-batching-benchmarks
  ☆116Updated last year
• BlackSamorez / tensor_parallel
  Automatically split your PyTorch models on multiple GPUs for training & inference
  ☆650Updated last year
• hao-ai-lab / LookaheadDecoding
  [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
  ☆1,218Updated 2 weeks ago
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆516Updated 10 months ago
• tpoisonooo / llama.onnx
  LLaMa/RWKV onnx models, quantization and testcase
  ☆359Updated last year
• hpcaitech / ColossalAI-Benchmark
  Performance benchmarking with ColossalAI
  ☆39Updated 2 years ago