apd10 / universal_memory_allocationLinks
☆15Updated 3 years ago
Alternatives and similar repositories for universal_memory_allocation
Users that are interested in universal_memory_allocation are comparing it to the libraries listed below
Sorting:
- [ NeurIPS '22 ] Data distillation for recommender systems. Shows equivalent performance with 2-3 orders less data.☆23Updated 2 years ago
- High performance pytorch modules☆18Updated 2 years ago
- ☆14Updated 3 years ago
- Differentiable Product Quantization for End-to-End Embedding Compression.☆62Updated 2 years ago
- A Learnable LSH Framework for Efficient NN Training☆32Updated 4 years ago
- A compressed alternative to matrix multiplication using state-of-the art compression ROBE-Z☆9Updated last year
- Confident Adaptive Transformers☆12Updated 4 years ago
- Implementation of vector quantization algorithms, codes for Norm-Explicit Quantization: Improving Vector Quantization for Maximum Inner P…☆59Updated 4 years ago
- Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012☆49Updated 3 years ago
- A study of the downstream instability of word embeddings☆12Updated 2 years ago
- Ancestral Gumbel-Top-k Sampling☆25Updated 5 years ago
- This is a Tensor Train based compression library to compress sparse embedding tables used in large-scale machine learning models such as …☆194Updated 3 years ago
- Hyperparameter tuning via uncertainty modeling☆47Updated last year
- sigma-MoE layer☆20Updated last year
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆49Updated 3 years ago
- ☆32Updated last year
- Time-based Sequence Model for Personalization and Recommendation Systems☆49Updated 3 years ago
- Codes of the paper Deformable Butterfly: A Highly Structured and Sparse Linear Transform.☆12Updated 3 years ago
- A memory efficient DLRM training solution using ColossalAI☆105Updated 2 years ago
- "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation☆29Updated 6 months ago
- ☆27Updated 5 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆50Updated 3 years ago
- AdamW optimizer for bfloat16 models in pytorch 🔥.☆35Updated last year
- ☆29Updated 2 years ago
- ☆15Updated 3 years ago
- ☆60Updated 5 years ago
- Research and development for optimizing transformers☆129Updated 4 years ago
- DL Dataloader Benchmarks☆19Updated 6 months ago
- [ICLR 2021] "UMEC: Unified Model and Embedding Compression for Efficient Recommendation Systems" by Jiayi Shen, Haotao Wang*, Shupeng Gui…☆39Updated 3 years ago
- Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)☆16Updated 3 years ago