wolfecameron / GISTLinks
Repository for "GIST: Distributed training for large-scale graph convolutional networks"
☆15Updated 2 years ago
Alternatives and similar repositories for GIST
Users that are interested in GIST are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems☆29Updated 2 years ago
- ☆10Updated last year
- Using FlexAttention to compute attention with different masking patterns☆44Updated 11 months ago
- Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"☆65Updated last year
- Multimodal Graph Learning: how to encode multiple multimodal neighbors with their relations into LLMs☆65Updated last year
- ☆30Updated last year
- ☆26Updated last year
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆36Updated last year
- Lottery Ticket Adaptation☆39Updated 10 months ago
- Can GPT-4 Perform Neural Architecture Search?☆87Updated 2 years ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆81Updated 2 years ago
- ☆19Updated 7 months ago
- Code for this paper "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts via HyperNetwork"☆33Updated last year
- KV Cache Steering for Inducing Reasoning in Small Language Models☆39Updated last month
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆33Updated last year
- Official implementation of "Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning"☆21Updated 3 months ago
- Pytorch Implementation of Automatic Relation-aware Graph Network Proliferation (CVPR 2022 Oral)☆26Updated last year
- ☆51Updated last year
- AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers☆47Updated 2 years ago
- Repository for CPU Kernel Generation for LLM Inference☆26Updated 2 years ago
- Implementation of Hyena Hierarchy in JAX☆10Updated 2 years ago
- [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)☆33Updated 2 years ago
- Unit Scaling demo and experimentation code☆16Updated last year
- 32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.☆49Updated 2 years ago
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆56Updated last year
- Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …☆115Updated last year
- PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"☆37Updated last year
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆30Updated 10 months ago
- Linear Attention Sequence Parallelism (LASP)☆86Updated last year
- Codebase for Instruction Following without Instruction Tuning☆35Updated 11 months ago