wolfecameron / GIST
Repository for "GIST: Distributed training for large-scale graph convolutional networks"
☆14Updated 2 years ago
Alternatives and similar repositories for GIST:
Users that are interested in GIST are comparing it to the libraries listed below
- [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems☆29Updated last year
- ☆9Updated last year
- Official implementation for Sparse MetA-Tuning (SMAT)☆16Updated 7 months ago
- AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers☆42Updated 2 years ago
- 📰 Computing the information content of trained neural networks☆21Updated 3 years ago
- The implementation of HyperND from the Nonlinear Feature Diffusion on Hypergraphs paper☆13Updated 2 years ago
- Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]☆18Updated last month
- ☆15Updated last year
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆79Updated last year
- official repo of AAAI2024 paper Mitigating the Impact of False Negatives in Dense Retrieval with Contrastive Confidence Regularization☆13Updated last year
- code for paper "Accessing higher dimensions for unsupervised word translation"☆21Updated last year
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆28Updated 8 months ago
- ☆11Updated 11 months ago
- Recycling diverse models☆44Updated 2 years ago
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆31Updated last year
- Implementation of Hyena Hierarchy in JAX☆10Updated last year
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- A testbed for agents and environments that can automatically improve models through data generation.☆18Updated 2 months ago
- Lottery Ticket Adaptation☆37Updated 3 months ago
- possibly useful materials for learning RWKV language model.☆24Updated last year
- Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…☆19Updated last year
- Code for "Merging Text Transformers from Different Initializations"☆19Updated 2 weeks ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated last week
- Towards Understanding the Mixture-of-Experts Layer in Deep Learning☆22Updated last year
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆20Updated 2 months ago
- Linear Attention Sequence Parallelism (LASP)☆77Updated 8 months ago
- Google Research☆46Updated 2 years ago
- Minimum Description Length probing for neural network representations☆18Updated 3 weeks ago
- ☆21Updated 2 years ago
- This repo contains data and code for the paper "Reasoning over Public and Private Data in Retrieval-Based Systems."☆47Updated 7 months ago