ablghtianyi / ICL_Modular_Arithmetic
☆18Updated last month
Alternatives and similar repositories for ICL_Modular_Arithmetic:
Users that are interested in ICL_Modular_Arithmetic are comparing it to the libraries listed below
- ☆31Updated 4 months ago
- ☆19Updated 10 months ago
- Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""☆14Updated 8 months ago
- ☆20Updated 2 months ago
- ☆23Updated 2 months ago
- [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…☆16Updated 2 weeks ago
- ☆14Updated last year
- Unofficial Implementation of Selective Attention Transformer☆16Updated 6 months ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Updated last year
- [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)☆77Updated 6 months ago
- An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)☆26Updated 2 months ago
- ☆31Updated 6 months ago
- Lightweight Adapting for Black-Box Large Language Models☆22Updated last year
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆29Updated last month
- ☆16Updated 3 weeks ago
- Efficient Scaling laws and collaborative pretraining.☆16Updated 3 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆72Updated 6 months ago
- Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"☆9Updated last month
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆35Updated 6 months ago
- ☆78Updated 8 months ago
- ☆49Updated last month
- The repository contains code for Adaptive Data Optimization☆24Updated 5 months ago
- Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"☆15Updated last month
- MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248☆52Updated 10 months ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆63Updated last month
- A testbed for agents and environments that can automatically improve models through data generation.☆24Updated 2 months ago
- ☆31Updated last year
- Universal Neurons in GPT2 Language Models☆28Updated 11 months ago
- What Makes a Reward Model a Good Teacher? An Optimization Perspective☆28Updated 3 weeks ago
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆26Updated 6 months ago