Pre-training code for Amber 7B LLM
☆172May 10, 2024Updated last year
Alternatives and similar repositories for amber-train
Users that are interested in amber-train are comparing it to the libraries listed below
Sorting:
- Pre-training code for CrystalCoder 7B LLM☆57May 10, 2024Updated last year
- Data preparation code for Amber 7B LLM☆93May 10, 2024Updated last year
- Data preparation code for CrystalCoder 7B LLM☆43May 10, 2024Updated last year
- Open Implementations of LLM Analyses☆107Oct 8, 2024Updated last year
- ☆52Jun 6, 2024Updated last year
- [ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices☆668May 10, 2025Updated 9 months ago
- The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.☆51Oct 18, 2024Updated last year
- Official Code for ParrotTTS☆58Oct 13, 2024Updated last year
- Offical code repository for PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillation, EMNLP 2023☆12Dec 13, 2023Updated 2 years ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆282Jul 11, 2024Updated last year
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆127Jan 14, 2025Updated last year
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆42Dec 29, 2025Updated 2 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated 5 months ago
- ☆16Jul 23, 2024Updated last year
- A MoE impl for PyTorch, [ATC'23] SmartMoE☆71Jul 11, 2023Updated 2 years ago
- Modeling, training, eval, and inference code for OLMo☆6,326Nov 24, 2025Updated 3 months ago
- A collection of strong multimodal models for building multimodal AGI agents☆44Jul 9, 2024Updated last year
- [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement☆193Mar 25, 2024Updated last year
- Implementation of the Mamba SSM with hf_integration.☆55Aug 31, 2024Updated last year
- The hub for EleutherAI's work on interpretability and learning dynamics☆2,740Nov 15, 2025Updated 3 months ago
- Scripts for downloading and pre-processing the `proof-pile`, a high quality dataset of mathematical text and code.☆22Nov 26, 2022Updated 3 years ago
- Reaching LLaMA2 Performance with 0.1M Dollars☆988Jul 23, 2024Updated last year
- Minimalistic large language model 3D-parallelism training☆2,579Feb 19, 2026Updated last week
- Data and tools for generating and inspecting OLMo pre-training data.☆1,411Nov 5, 2025Updated 3 months ago
- ☆10Oct 2, 2024Updated last year
- ☆16Jun 25, 2025Updated 8 months ago
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆8,896May 3, 2024Updated last year
- ☆42May 9, 2024Updated last year
- [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models☆66Dec 10, 2024Updated last year
- Distributed IO-aware Attention algorithm☆24Sep 24, 2025Updated 5 months ago
- ☆44Nov 17, 2024Updated last year
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆946Feb 16, 2025Updated last year
- [ACL 2024] Progressive LLaMA with Block Expansion.☆514May 20, 2024Updated last year
- [ACL 2023] Gradient Ascent Post-training Enhances Language Model Generalization☆29Sep 12, 2024Updated last year
- Code for the paper Code for the paper InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning☆100May 6, 2023Updated 2 years ago
- Nested Named Entity Recognition for Chinese Biomedical Text☆11Jan 25, 2024Updated 2 years ago
- ☆12Apr 24, 2024Updated last year
- Code and Dataset release of "Carpe Diem: On the Evaluation of World Knowledge in Lifelong Language Models" (NAACL 2024)☆10Oct 16, 2024Updated last year
- ☆15Aug 19, 2025Updated 6 months ago