davisyoshida / jax-gptqLinks
JAX implementation of GPTQ quantization algorithm
☆10Updated 2 years ago
Alternatives and similar repositories for jax-gptq
Users that are interested in jax-gptq are comparing it to the libraries listed below
Sorting:
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated last year
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆73Updated last year
- Custom triton kernels for training Karpathy's nanoGPT.☆19Updated 10 months ago
- Simple and efficient pytorch-native transformer training and inference (batched)☆78Updated last year
- Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)☆20Updated 2 years ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆61Updated 10 months ago
- ☆20Updated 2 years ago
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆116Updated 2 years ago
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆87Updated last year
- A toolkit for scaling law research ⚖☆50Updated 7 months ago
- Language models scale reliably with over-training and on downstream tasks☆98Updated last year
- some common Huggingface transformers in maximal update parametrization (µP)☆82Updated 3 years ago
- Parallel Associative Scan for Language Models☆18Updated last year
- ☆87Updated last year
- ☆48Updated last year
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆85Updated last month
- A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/…☆23Updated 5 months ago
- ☆37Updated last year
- ☆49Updated last year
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆61Updated 4 months ago
- train with kittens!☆62Updated 10 months ago
- Simple repository for training small reasoning models☆37Updated 6 months ago
- Machine Learning eXperiment Utilities☆46Updated last month
- ☆51Updated last year
- ☆13Updated 3 months ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆50Updated last year
- ☆53Updated last year
- JAX implementation of the Llama 2 model☆219Updated last year
- Supercharge huggingface transformers with model parallelism.☆77Updated last month
- A set of Python scripts that makes your experience on TPU better☆54Updated last year