Alternatives and similar repositories for poet

Users that are interested in poet are comparing it to the libraries listed below

• awslabs / slapo
  A schedule language for large model training
  ☆148Updated 11 months ago
• microsoft / varuna
  ☆250Updated 10 months ago
• IntelLabs / FP8-Emulation-Toolkit
  PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.
  ☆110Updated 6 months ago
• Cornell-RelaxML / QuIP
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"
  ☆369Updated last year
• mlc-ai / llm-perf-bench
  ☆119Updated last year
• haochengxi / Train_Transformers_with_INT4
  ☆151Updated last year
• SqueezeAILab / SqueezeLLM
  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
  ☆689Updated 9 months ago
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆61Updated 4 months ago
• yandex-research / swarm
  Official code for "SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient"
  ☆140Updated last year
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆113Updated 2 years ago
• Qualcomm-AI-research / FP8-quantization
  ☆149Updated 2 years ago
• amirgholami / ai_and_memory_wall
  AI and Memory Wall
  ☆216Updated last year
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆223Updated 10 months ago
• efeslab / Atom
  [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
  ☆307Updated 11 months ago
• stanford-futuredata / stk
  ☆105Updated 9 months ago
• IST-DASLab / OBC
  Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".
  ☆120Updated last year
• Guangxuan-Xiao / torch-int
  This repository contains integer operators on GPUs for PyTorch.
  ☆205Updated last year
• cli99 / llm-analysis
  Latency and Memory Analysis of Transformer Models for Training and Inference
  ☆424Updated last month
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆311Updated this week
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆251Updated 7 months ago
• facebookresearch / LLM-QAT
  Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"
  ☆292Updated 3 months ago
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆384Updated last week
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆211Updated last year
• hidet-org / hidet
  An open-source efficient deep learning framework/compiler, written in python.
  ☆700Updated this week
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated last year
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆152Updated last year
• DS3Lab / DT-FM
  ☆94Updated 2 years ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆64Updated last year
• awslabs / raf
  ☆144Updated 4 months ago