Alternatives and similar repositories for cot-icl-lab

Users that are interested in cot-icl-lab are comparing it to the libraries listed below

• HazyResearch / aisys-building-blocks
  Building blocks for foundation models.
  ☆502Updated last year
• ScalingIntelligence / KernelBench
  KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems
  ☆374Updated this week
• tile-ai / tilelang
  Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels
  ☆1,250Updated this week
• hemingkx / SpeculativeDecodingPapers
  📰 Must-read papers and blogs on Speculative Decoding ⚡️
  ☆763Updated this week
• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆1,518Updated this week
• NVIDIA / NeMo-RL
  Scalable toolkit for efficient model reinforcement
  ☆385Updated this week
• NVIDIA / kvpress
  LLM KV cache compression made easy
  ☆497Updated this week
• October2001 / Awesome-KV-Cache-Compression
  📰 Must-read papers on KV Cache Compression (constantly updating 🤗).
  ☆431Updated last week
• stanford-cs336 / spring2024-lectures
  ☆293Updated 5 months ago
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,671Updated 6 months ago
• NVIDIA / NeMo-Aligner
  Scalable toolkit for efficient model alignment
  ☆807Updated this week
• haizhongzheng / LTE
  ☆10Updated 7 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,898Updated last week
• ByteDance-Seed / Triton-distributed
  Distributed Triton for Parallel Systems
  ☆775Updated last week
• volcengine / veScale
  A PyTorch Native LLM Training Framework
  ☆816Updated 5 months ago
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆396Updated last month
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆173Updated this week
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆3,088Updated this week
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆183Updated last month
• henryzhongsc / longctx_bench
  Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark o…
  ☆78Updated 3 months ago
• vllm-project / llm-compressor
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
  ☆1,441Updated this week
• rwitten / HighPerfLLMs2024
  ☆487Updated 10 months ago
• gpu-mode / awesomeMLSys
  An ML Systems Onboarding list
  ☆794Updated 4 months ago
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆307Updated 3 months ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆1,194Updated 6 months ago
• AmadeusChan / Awesome-LLM-System-Papers
  ☆591Updated 3 weeks ago
• zhuzilin / ring-flash-attention
  Ring attention implementation with flash attention
  ☆774Updated 2 weeks ago
• nsfzyzz / Generalization_metrics_for_NLP
  [KDD 2023] code for "Test accuracy vs. generalization gap: model selection in NLP without accessing training or testing data" https://arx…
  ☆12Updated 2 years ago
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆249Updated this week
• AmberLJC / LLMSys-PaperList
  Large Language Model (LLM) Systems Paper List
  ☆1,254Updated this week