Alternatives and similar repositories for chai

Users that are interested in chai are comparing it to the libraries listed below

• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆16Updated 7 months ago
• sustcsonglin / gated_linear_attention_layer
  ☆32Updated last year
• cloneofsimo / fim-llama-deepspeed
  ☆31Updated last year
• SmerkyG / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆10Updated 3 weeks ago
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆23Updated last year
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆59Updated last year
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆36Updated last year
• sekstini / basedxl
  ☆17Updated last year
• facebookresearch / RLCompOpt
  Learning Compiler Pass Orders using Coreset and Normalized Value Prediction. (ICML 2023)
  ☆19Updated last year
• jongwooko / distillm-2
  ☆15Updated 2 months ago
• kyegomez / MobileVLM
  Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …
  ☆15Updated last year
• yandex-research / vqdm
  Official repository for VQDM:Accurate Compression of Text-to-Image Diffusion Models via Vector Quantization paper
  ☆33Updated 8 months ago
• RAIVNLab / MatFormer-OLMo
  Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…
  ☆22Updated last year
• Gen-Verse / CURE
  Open-Source LLM Coders with Co-Evolving Reinforcement Learning
  ☆40Updated this week
• bentherien / mu_learned_optimization
  [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
  ☆12Updated 2 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 10 months ago
• ldery / Bonsai
  Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"
  ☆28Updated last year
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆47Updated last month
• zaydzuhri / pythia-mlkv
  Multi-Layer Key-Value sharing experiments on Pythia models
  ☆33Updated 11 months ago
• akhilkedia / TranformersGetStable
  [ICML 2024] Official Repository for the paper "Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models"
  ☆10Updated 10 months ago
• Netflix / clove
  ☆13Updated 9 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆21Updated 4 months ago
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆20Updated 11 months ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated this week
• glassroom / heinsen_attention
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆24Updated last year
• taehong-moon / ee-diffusion
  Official Code Implementation for 'A Simple Early Exiting Framework for Accelerated Sampling in Diffusion Models'
  ☆19Updated 10 months ago
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆36Updated 11 months ago
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated last year
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆32Updated 9 months ago
• SprocketLab / sparse_matrix_fine_tuning
  Official repository for ICML 2024 paper "MoRe Fine-Tuning with 10x Fewer Parameters"
  ☆18Updated 2 weeks ago