SamsungSAILMontreal / nino
Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks"
☆14Updated last week
Related projects ⓘ
Alternatives and complementary repositories for nino
- Minimum Description Length probing for neural network representations☆16Updated last week
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 8 months ago
- A scalable implementation of diffusion and flow-matching with XGBoost models, applied to calorimeter data.☆17Updated last week
- ☆21Updated last month
- Lottery Ticket Adaptation☆36Updated last month
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated last week
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆13Updated last month
- ☆12Updated 2 months ago
- Understanding how features learned by neural networks evolve throughout training☆31Updated 2 weeks ago
- DPO, but faster 🚀☆21Updated 2 weeks ago
- A Data Source for Reasoning Embodied Agents☆19Updated last year
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆37Updated 5 months ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆36Updated 11 months ago
- The repository contains code for Adaptive Data Optimization☆18Updated 3 weeks ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆24Updated last week
- ☆40Updated this week
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 5 months ago
- GoldFinch and other hybrid transformer components☆39Updated 3 months ago
- ☆28Updated last year
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆13Updated 8 months ago
- Implementation of a holodeck, written in Pytorch☆17Updated last year
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆36Updated 2 years ago
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆30Updated 9 months ago
- Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"☆50Updated last month
- A repository for research on medium sized language models.☆74Updated 5 months ago
- ☆21Updated last week
- PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023☆19Updated last year
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated last year