facebookresearch / chai
CHAI is a library for dynamic pruning of attention heads for efficient LLM inference.
☆11Updated last month
Alternatives and similar repositories for chai:
Users that are interested in chai are comparing it to the libraries listed below
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated 7 months ago
- implementation of https://arxiv.org/pdf/2312.09299☆20Updated 6 months ago
- ☆12Updated 4 months ago
- [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers☆11Updated last month
- Training hybrid models for dummies.☆16Updated this week
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆14Updated 2 weeks ago
- Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"☆15Updated 2 months ago
- ☆15Updated last month
- FlexAttention w/ FlashAttention3 Support☆27Updated 3 months ago
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆15Updated 10 months ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Updated 2 months ago
- ☆31Updated last year
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Updated 3 years ago
- Implementation of a holodeck, written in Pytorch☆17Updated last year
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 7 months ago
- Implementation of Hyena Hierarchy in JAX☆10Updated last year
- Minimum Description Length probing for neural network representations☆18Updated last week
- Implementation of SoundtStream from the paper: "SoundStream: An End-to-End Neural Audio Codec"☆12Updated 2 months ago
- ☆18Updated 8 months ago
- [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluating☆33Updated this week
- code for paper "Accessing higher dimensions for unsupervised word translation"☆21Updated last year
- Drastically Reducing the Number of Trainable Parameters in Deep CNNs by Inter-layer Kernel-sharing☆12Updated last year
- Synthesizing realistic and diverse text-datasets from augmented LLMs☆10Updated last week
- Visualising Losses in Deep Neural Networks☆15Updated 6 months ago
- Code for paper: "Privately generating tabular data using language models".☆14Updated last year
- HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]☆14Updated last year
- ☆33Updated 4 months ago
- The original weights of some Caffe models, ported to PyTorch.☆11Updated 3 years ago