Implementation of CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation
☆26Sep 30, 2026Updated last month
Alternatives and similar repositories for CoLA
Users that are interested in CoLA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A compositional generalization suite for world model research☆24Oct 28, 2026Updated 3 weeks ago
- A bit-exact Balatro simulator in Rust with a Python interface, built as a reinforcement learning environment.☆22Updated this week
- ☆20Feb 2, 2026Updated 9 months ago
- (ICLR '26) Safety Subspaces are Not Linearly Distinct: A Fine-Tuning Case Study☆13Oct 4, 2025Updated last year
- ☆10Aug 13, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆12Jul 17, 2025Updated last year
- Orthogonal Subspace Learning for Continual Learning☆15Apr 23, 2025Updated last year
- Official repo for paper: Universal Reasoner: A Single, Composable Plug-and-Play Reasoner for Frozen LLMs☆20Nov 26, 2025Updated 11 months ago
- Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning☆52Oct 17, 2025Updated last year
- ☆10Apr 16, 2024Updated 2 years ago
- ☆29May 13, 2025Updated last year
- ☆14Jan 10, 2024Updated 2 years ago
- This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆54Jan 15, 2026Updated 10 months ago
- [EMNLP 2024] Quantize LLM to extremely low-bit, and finetune the quantized LLMs☆17Jul 18, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This repository contains the source code and links to some datasets used in the CoNLL 2019 paper "Learning to Represent Bilingual Diction…☆12Oct 1, 2020Updated 6 years ago
- The official source code for "Physics-Embedded Graph Neural Operator for Interaction-Controlled Colloidal Aggregation" (Water Research, …☆10Mar 22, 2026Updated 7 months ago
- VQE on photonic quantum devices☆19Oct 1, 2026Updated last month
- My tests and experiments with some popular dl frameworks.☆17Sep 11, 2025Updated last year
- ☆19Nov 6, 2023Updated 3 years ago
- [NAACL 24 Oral] LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models☆40Jan 9, 2025Updated last year
- Code implementation for paper "On the Efficacy of Small Self-Supervised Contrastive Models without Distillation Signals".☆17Dec 15, 2021Updated 4 years ago
- So, I trained a Llama a 130M architecture I coded from ground up to build a small instruct model from scratch. Trained on FineWeb dataset…☆17Mar 26, 2025Updated last year
- ☆15May 4, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Codebase for adaptive continual memory☆15Aug 15, 2023Updated 3 years ago
- A library for activation patching based on nnsight.☆12May 27, 2025Updated last year
- [KDD 2025] Code for the paper "Oldie but Goodie: Re-illuminating Label Propagation on Graphs with Partially Observed Features"☆12Aug 4, 2025Updated last year
- Implementation of LaViC (KDD 2025)☆13Jun 1, 2025Updated last year
- A Continual Learning Library in PyTorch and JAX☆13Apr 18, 2023Updated 3 years ago
- Variance Covariance Regularization☆14Jun 22, 2023Updated 3 years ago
- PyTorch implementation of the SIESTA algorithm from our TMLR-2023 paper "SIESTA: Efficient Online Continual Learning with Sleep"☆13Oct 25, 2024Updated 2 years ago
- [NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections☆22Oct 15, 2024Updated 2 years ago
- MSCRS☆12Nov 8, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- FRANK: Factuality Evaluation Benchmark☆61Dec 13, 2022Updated 3 years ago
- MultiLabel classification of cow diseases by text and symptoms recognition (NER)☆12Aug 13, 2022Updated 4 years ago
- Official Implementation of Budgeted Online Continual Learning by Adaptive Layer Freezing and Frequency-based Sampling (ICLR'25-Spotlight)☆12Jan 21, 2026Updated 9 months ago
- ☆14Dec 13, 2024Updated last year
- This is anonymous repository for submitting our work to a conference☆14Dec 17, 2024Updated last year
- A tutorial on 1) setting up a local LLM, and 2) configuring a FastAPI server to expose a local LLM to the public internet for inference u…☆12Jun 7, 2024Updated 2 years ago
- An implementation of the DISP-LLM method from the NeurIPS 2024 paper: Dimension-Independent Structural Pruning for Large Language Models.☆25Aug 6, 2025Updated last year
Are these results useful?