Alternatives and similar repositories for cuda_float_compress

Users that are interested in cuda_float_compress are comparing it to the libraries listed below

• catid / lllm
  Latent Large Language Models
  ☆18Updated last year
• NolanoOrg / SpectraSuite
  ☆51Updated last year
• yandex-research / swarm
  Official code for "SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient"
  ☆143Updated last year
• HazyResearch / train-tk
  train with kittens!
  ☆62Updated 11 months ago
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆121Updated 2 weeks ago
• Scientific-Computing-Lab / MPI-rigen
  MPI Code Generation through Domain-Specific Language Models
  ☆14Updated 10 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆129Updated 9 months ago
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆68Updated last year
• google-deepmind / asyncdiloco
  ☆46Updated last year
• RAIVNLab / AdANNS
  Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"
  ☆65Updated last year
• zaydzuhri / flame
  Fork of Flame repo for training of some new stuff in development
  ☆17Updated 3 weeks ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated 2 years ago
• cchan / nanoGPT-fp8
  ☆13Updated 2 years ago
• eth-easl / deltazip
  Compression for Foundation Models
  ☆35Updated 2 months ago
• NousResearch / StripedHyenaTrainer
  ☆62Updated last year
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆19Updated 2 months ago
• sekstini / basedxl
  ☆18Updated last year
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆41Updated last year
• kyegomez / SelfExtend
  Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta
  ☆13Updated 10 months ago
• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆74Updated 7 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆46Updated last year
• UmerHA / triton_util
  Make triton easier
  ☆47Updated last year
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆94Updated this week
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆86Updated last year
• schwartz-lab-NLP / TOVA
  Token Omission Via Attention
  ☆128Updated 11 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆88Updated 4 months ago
• kyegomez / EXA-1
  An EXA-Scale repository of Multi-Modality AI resources from papers and models, to foundational libraries!
  ☆40Updated last year
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆73Updated last year
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated last year
• EleutherAI / training-jacobian
  ☆23Updated 9 months ago