wolfecameron / GIST
Repository for "GIST: Distributed training for large-scale graph convolutional networks"
☆14Updated 2 years ago
Alternatives and similar repositories for GIST:
Users that are interested in GIST are comparing it to the libraries listed below
- [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems☆29Updated 2 years ago
- Using FlexAttention to compute attention with different masking patterns☆43Updated 7 months ago
- Lottery Ticket Adaptation☆39Updated 5 months ago
- The implementation of HyperND from the Nonlinear Feature Diffusion on Hypergraphs paper☆13Updated 2 years ago
- A testbed for agents and environments that can automatically improve models through data generation.☆23Updated last month
- Low-Rank Llama Custom Training☆22Updated last year
- Official implementation for Sparse MetA-Tuning (SMAT)☆16Updated 9 months ago
- ☆15Updated last year
- The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".☆20Updated 5 months ago
- ☆9Updated last year
- Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]☆19Updated last month
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆30Updated 10 months ago
- Efficient Scaling laws and collaborative pretraining.☆16Updated 3 months ago
- Implementation of Spectral State Space Models☆16Updated last year
- ☆31Updated 3 months ago
- Aioli: A unified optimization framework for language model data mixing☆23Updated 3 months ago
- GeoT: Tensor Centric Library for Graph Neural Network via Efficient Segment Reduction on GPU☆22Updated last month
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆34Updated last year
- ☆21Updated 3 weeks ago
- Implementation of Hyena Hierarchy in JAX☆10Updated last year
- ☆15Updated 2 months ago
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆22Updated 4 months ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆80Updated last year
- Code for "Merging Text Transformers from Different Initializations"☆20Updated 2 months ago
- 📰 Computing the information content of trained neural networks☆21Updated 3 years ago
- Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…☆19Updated last year
- ☆22Updated 2 years ago
- We study toy models of skill learning.☆25Updated 3 months ago
- JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)☆33Updated last year
- On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability☆38Updated 3 months ago