thepowerfuldeez / OLMoLinks
My fork os allen AI's OLMo for educational purposes.
☆30Updated last year
Alternatives and similar repositories for OLMo
Users that are interested in OLMo are comparing it to the libraries listed below
Sorting:
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks (EMNLP'24)☆148Updated last year
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆102Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆37Updated 2 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆118Updated last year
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆202Updated last year
- A repository for research on medium sized language models.☆77Updated last year
- This is the official repository for Inheritune.☆116Updated 10 months ago
- ☆48Updated last year
- Collection of autoregressive model implementation☆85Updated 7 months ago
- ☆70Updated last year
- ☆89Updated last year
- ☆81Updated last year
- EvaByte: Efficient Byte-level Language Models at Scale☆111Updated 8 months ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆58Updated 2 weeks ago
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆205Updated last year
- [ICML 2025] From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories and Applications☆52Updated last month
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆162Updated 8 months ago
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆35Updated 9 months ago
- Efficient Infinite Context Transformers with Infini-attention Pytorch Implementation + QwenMoE Implementation + Training Script + 1M cont…☆83Updated last year
- ☆86Updated last year
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 11 months ago
- PyTorch implementation of models from the Zamba2 series.☆186Updated 10 months ago
- A pipeline for LLM knowledge distillation☆111Updated 8 months ago
- Simple repository for training small reasoning models☆47Updated 10 months ago
- ☆55Updated last year
- ☆52Updated last year
- ☆125Updated 10 months ago
- ☆136Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- RWKV-7: Surpassing GPT☆101Updated last year