ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]
☆202Jul 16, 2025Updated 7 months ago
Alternatives and similar repositories for zo2
Users that are interested in zo2 are comparing it to the libraries listed below
Sorting:
- Official code for DeepSound-V1☆13May 14, 2025Updated 9 months ago
- [ACL'25] UTBoost: Rigorous Evaluation of Coding Agents on SWE-Bench☆35Aug 12, 2025Updated 6 months ago
- This repository contains the code for our ICML 2025 paper——LENSLLM: Unveiling Fine-Tuning Dynamics for LLM Selection🎉☆26May 29, 2025Updated 9 months ago
- ☆21Nov 27, 2025Updated 3 months ago
- (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…☆127Nov 8, 2025Updated 3 months ago
- [NeurIPS 2024] A Novel Rank-Based Metric for Evaluating Large Language Models☆57May 28, 2025Updated 9 months ago
- BPfold: Deep generalizable prediction of RNA secondary structure via base pair motif energy.☆31Feb 24, 2026Updated last week
- [IEEE TPAMI 2025] Privacy-Preserving Biometric Verification With Handwritten Random Digit String☆67Aug 3, 2025Updated 7 months ago
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆50Aug 20, 2025Updated 6 months ago
- [ICLR 2025] The offical implementation of "PSEC: Skill Expansion and Composition in Parameter Space", a new framework designed to facilit…☆63Feb 12, 2025Updated last year
- [ICML2025] Official Code of From Local Details to Global Context: Advancing Vision-Language Models with Attention-Based Selection☆25Jun 27, 2025Updated 8 months ago
- 🏆 Official implementation of LangCoop: Collaborative Driving with Natural Language☆77Sep 12, 2025Updated 5 months ago
- [ICML2025] The official implementation of "C-3PO: Compact Plug-and-Play Proxy Optimization to Achieve Human-like Retrieval-Augmented Gene…☆42May 3, 2025Updated 10 months ago
- MTalk-Bench: Evaluating Speech-to-Speech Models in Multi-Turn Dialogues via Arena-style and Rubrics Protocols☆17Nov 19, 2025Updated 3 months ago
- [ICLR 2025] Official Implementation of Local-Prompt: Extensible Local Prompts for Few-Shot Out-of-Distribution Detection☆51Jul 30, 2025Updated 7 months ago
- Reconstructing spatiotemporal dynamics from spatial transcriptome snapshots☆34Jun 26, 2025Updated 8 months ago
- [RSE 2025] RESTORE-DiT: Reliable satellite image time series reconstruction by multimodal sequential diffusion transformer☆54Jul 7, 2025Updated 8 months ago
- [TGRS 2023] Official code for "EARL: An Elliptical Distribution aided Adaptive Label Assignment for Oriented Object Detection in Remote S…☆14Oct 11, 2023Updated 2 years ago
- [ACL'25 Main] Official Implementation of HiDe-LLaVA: Hierarchical Decoupling for Continual Instruction Tuning of Multimodal Large Languag…☆49Feb 16, 2026Updated 2 weeks ago
- Fun project to run your own LLM chat bot using llama.cpp☆11Jun 9, 2023Updated 2 years ago
- Official Code for Paper: Beyond Matryoshka: Revisiting Sparse Coding for Adaptive Representation☆134Jan 7, 2026Updated 2 months ago
- PyTorch code for our paper "Progressive Binarization with Semi-Structured Pruning for LLMs"☆13Sep 28, 2025Updated 5 months ago
- 博查 - 多模型AI搜索，答案快如闪电☆14Apr 19, 2024Updated last year
- Chinese-Mimi 是对 Moshi 模型的声码器进行了中文语料上的适配。☆34Mar 13, 2025Updated 11 months ago
- [CVPR 2025] The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generation☆111Oct 27, 2025Updated 4 months ago
- ☆16Feb 19, 2026Updated 2 weeks ago
- GCL implementation☆14Mar 7, 2024Updated 2 years ago
- Does patch ordering affect context-limited vision transformers?☆17Oct 10, 2025Updated 4 months ago
- D^2-MoE: Delta Decompression for MoE-based LLMs Compression☆72Mar 25, 2025Updated 11 months ago
- [NeurIPS 2022 Spotlight] The official GitHub page of "MSDS: A Large-Scale Chinese Signature and Token Digit String Dataset for Handwritin…☆91Aug 3, 2025Updated 7 months ago
- A toolkit for scaling law research ⚖☆57Jan 27, 2025Updated last year
- Our 2nd-gen LMM☆34May 22, 2024Updated last year
- Official code for the paper "HEXA-MoE: Efficient and Heterogeneous-Aware MoE Acceleration with Zero Computation Redundancy"☆15Mar 6, 2025Updated last year
- [ACL 24 Findings] Implementation of Resonance RoPE and the PosGen synthetic dataset.☆24Mar 5, 2024Updated 2 years ago
- [CVPR 2024 Highlight & TPAMI 2025] This is the official PyTorch implementation of "TFMQ-DM: Temporal Feature Maintenance Quantization for…☆108Sep 29, 2025Updated 5 months ago
- [COLING 2024] CMNEE: A Large-Scale Document-Level Event Extraction Dataset based on Open-Source Chinese Military News☆44Jan 26, 2026Updated last month
- 🦾 A Dual-System VLA with System2 Thinking☆133Aug 21, 2025Updated 6 months ago
- Official code for paper "SPA-RL: Reinforcing LLM Agent via Stepwise Progress Attribution"☆67Sep 13, 2025Updated 5 months ago
- ☆762Dec 23, 2025Updated 2 months ago