Compression schema for gradients of activations in backward pass
☆45Jul 26, 2023Updated 2 years ago
Alternatives and similar repositories for fewbit
Users that are interested in fewbit are comparing it to the libraries listed below
Sorting:
- Quadrature-based features for kernel approximation☆16Oct 30, 2018Updated 7 years ago
- ☆11Dec 6, 2020Updated 5 years ago
- A neural network training framework within a task-based parallel programming paradigm☆55Updated this week
- Faster and Lighter LoRA Implementations☆13Nov 21, 2024Updated last year
- Gradient-free optimization method for the multidimensional arrays and discretized multivariate functions based on the tensor train (TT) f…☆40Apr 29, 2025Updated 10 months ago
- Code for the paper "Faster Neural Network Training with Approximate Tensor Operations"☆10Oct 23, 2021Updated 4 years ago
- Code for reproducing the results from "CrAM: A Compression-Aware Minimizer" accepted at ICLR 2023☆10Mar 1, 2023Updated 3 years ago
- Metamodeling, sensitivity analysis and visualization using the tensor train format☆21Sep 8, 2022Updated 3 years ago
- ☆13Jul 25, 2024Updated last year
- Skoltech Geometric Computer Vision v.2021.1☆11Mar 22, 2021Updated 4 years ago
- First Latency-Aware Competitive LLM Agent Benchmark☆26Jun 3, 2025Updated 9 months ago
- ☆11Jun 29, 2021Updated 4 years ago
- Python bindings to llama.cpp☆27Mar 22, 2023Updated 2 years ago
- MUSCO: MUlti-Stage COmpression of neural networks☆72Feb 16, 2021Updated 5 years ago
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆19Oct 9, 2022Updated 3 years ago
- A Learnable LSH Framework for Efficient NN Training☆34Jul 22, 2021Updated 4 years ago
- A source-to-source compiler for optimizing CUDA dynamic parallelism by aggregating launches☆15Jun 21, 2019Updated 6 years ago
- some mixture of experts architecture implementations☆26Mar 22, 2024Updated last year
- Gradient-free optimization method for multivariable functions based on the low rank tensor train (TT) format and maximal-volume principle…☆38Jul 27, 2023Updated 2 years ago
- Python progress bar with rich output that uses native ipython functionality. Widget-free. Works even in JupyterLab.☆39Feb 10, 2019Updated 7 years ago
- Repository containing lectures from 2021 Machine Learning course☆12Aug 3, 2022Updated 3 years ago
- ☆15Oct 26, 2021Updated 4 years ago
- BESA is a differentiable weight pruning technique for large language models.☆17Mar 4, 2024Updated 2 years ago
- Telegram notification with IPython magics.☆61Jul 10, 2023Updated 2 years ago
- ☆11Feb 5, 2026Updated last month
- Fork of Flame repo for training of some new stuff in development☆19Updated this week
- Memory-efficient transformer. Work in progress.☆19Sep 17, 2022Updated 3 years ago
- Take control back!☆18Jun 22, 2022Updated 3 years ago
- Johnson-Lindenstrauss transform (JLT), random projections (RP), fast Johnson-Lindenstrauss transform (FJLT), and randomized Hadamard tran…☆23Jul 11, 2023Updated 2 years ago
- ☆52Nov 5, 2024Updated last year
- Contains the code and data for our #ICSE2022 paper titled as "CodeFill: Multi-token Code Completion by Jointly Learning from Structure an…☆15May 18, 2022Updated 3 years ago
- Adaptive floating-point based numerical format for resilient deep learning☆14Apr 11, 2022Updated 3 years ago
- ☆15Apr 26, 2022Updated 3 years ago
- [AISTATS2020] The official repository of "Invertible Generative Modling using Linear Rational Splines (LRS)".☆20May 12, 2023Updated 2 years ago
- ☆20Jul 19, 2024Updated last year
- NMF/NTF with Pytorch☆17Mar 24, 2019Updated 6 years ago
- Machine Learning in Neuroimaging data, Fall 2020.☆22Aug 3, 2022Updated 3 years ago
- FireQ: Fast INT4-FP8 Kernel and RoPE-aware Quantization for LLM Inference Acceleration☆20Jun 27, 2025Updated 8 months ago
- Beyond KV Caching: Shared Attention for Efficient LLMs☆20Jul 19, 2024Updated last year