Multi-Layer Key-Value sharing experiments on Pythia models
☆35Jun 14, 2024Updated 2 years ago
Alternatives and similar repositories for pythia-mlkv
Users that are interested in pythia-mlkv are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆31Jul 31, 2026Updated 2 months ago
- ☆16Jul 23, 2024Updated 2 years ago
- MPI Code Generation through Domain-Specific Language Models☆16Nov 19, 2024Updated last year
- ☆24Mar 7, 2025Updated last year
- Multilingual Pretraining for Pixel Language Models (EMNLP 2025, Official Implementation)☆13Feb 2, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- CHERRL: A Controllable Hacking Environment for Rubric-Based Reinforcement Learning☆16Oct 15, 2026Updated last week
- Token Omission Via Attention☆129Oct 13, 2024Updated 2 years ago
- The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.☆55Oct 18, 2024Updated 2 years ago
- ☆49Aug 27, 2026Updated last month
- QAQ: Quality Adaptive Quantization for LLM KV Cache☆55Mar 27, 2024Updated 2 years ago
- Code for paper: Optimizing Length Compression in Large Reasoning Models☆29Oct 20, 2025Updated last year
- Crosslingual Reasoning through Test-Time Scaling☆22May 13, 2025Updated last year
- [COLM 2024] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models☆25Oct 5, 2024Updated 2 years ago
- Testing paligemma2 finetuning on reasoning dataset☆18Dec 28, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆15Apr 11, 2024Updated 2 years ago
- ☆12Aug 4, 2026Updated 2 months ago
- code repo for GCR [FAST'26]☆17Mar 3, 2026Updated 7 months ago
- A base protocol providing streams of messages☆15Aug 22, 2025Updated last year
- Official code and data repository of MathChat: MathChat: Benchmarking Mathematical Reasoning and Instruction Following in Multi-Turn Inte…☆22Jun 3, 2024Updated 2 years ago
- Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging. Arxiv, 2024.☆16Oct 28, 2024Updated last year
- DataRubrics, a structured framework for assessing the quality of both human- and model-generated datasets. Leveraging recent advances in …☆16Jun 6, 2025Updated last year
- ☆19Mar 25, 2025Updated last year
- [IJCAI'19] Code for "Self-attentive Biaffine Dependency Parsing"☆16Jun 13, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code and data to explore neural scaling laws of xLSTM and Transformer models.☆24Apr 8, 2026Updated 6 months ago
- Dateset Reset Policy Optimization☆30Apr 12, 2024Updated 2 years ago
- LLM-Merging: Building LLMs Efficiently through Merging☆208Sep 24, 2024Updated 2 years ago
- IPFS private network☆10Jul 10, 2023Updated 3 years ago
- ☆23Dec 1, 2021Updated 4 years ago
- xKV: Cross-Layer SVD for KV-Cache Compression [ICML 2026]☆59Jul 7, 2026Updated 3 months ago
- Cross-lingual Language Model (XLM) pretraining and Model-Agnostic Meta-Learning (MAML) for fast adaptation of deep networks☆20Mar 26, 2021Updated 5 years ago
- Command helper for slurm system. Act as if you are on compute node.☆16Feb 1, 2025Updated last year
- ☆22Apr 22, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆89Apr 18, 2025Updated last year
- uTP implementation for Rust + tokio☆14Dec 23, 2019Updated 6 years ago
- Code for paper "Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation" (ICLR'24)☆13Nov 17, 2023Updated 2 years ago
- Works about Cucker-Smale model and its extensions. =Keywords: ODE, Runge-Kutta methods, SDE, Euler-Maruyama method, NumPy, Matplotlib☆11Feb 14, 2024Updated 2 years ago
- Official Code Implementation for 'A Simple Early Exiting Framework for Accelerated Sampling in Diffusion Models'☆20Jul 24, 2024Updated 2 years ago
- ☆21Jul 10, 2025Updated last year
- Godot 4.4 had a merge where we can get a android surface from a android plugin. This is a tryout for that☆14Sep 22, 2026Updated last month