allenai / OLMo-coreLinks
PyTorch building blocks for the OLMo ecosystem
β238Updated this week
Alternatives and similar repositories for OLMo-core
Users that are interested in OLMo-core are comparing it to the libraries listed below
Sorting:
- prime-rl is a codebase for decentralized async RL training at scaleβ341Updated this week
- πΎ OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.β379Updated 2 weeks ago
- Reproducible, flexible LLM evaluationsβ213Updated last month
- A project to improve skills of large language modelsβ429Updated this week
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.β125Updated this week
- An extension of the nanoGPT repository for training small MOE models.β152Updated 3 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"β303Updated last year
- Manage scalable open LLM inference endpoints in Slurm clustersβ260Updated 11 months ago
- Tina: Tiny Reasoning Models via LoRAβ260Updated 3 weeks ago
- Scalable toolkit for efficient model reinforcementβ438Updated this week
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, sparsβ¦β339Updated 6 months ago
- The HELMET Benchmarkβ154Updated 2 months ago
- SkyRL-v0: Train Real-World Long-Horizon Agents via Reinforcement Learningβ422Updated this week
- β193Updated 4 months ago
- β520Updated 7 months ago
- Benchmarking LLMs with Challenging Tasks from Real Usersβ226Updated 7 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".β205Updated 2 weeks ago
- The official evaluation suite and dynamic data release for MixEval.β242Updated 7 months ago
- π Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flashβ¦β253Updated this week
- A simple unified framework for evaluating LLMsβ219Updated 2 months ago
- Automatic evals for LLMsβ437Updated 2 weeks ago
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.β101Updated 4 months ago
- β200Updated this week
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).β255Updated last week
- β180Updated 2 months ago
- β125Updated this week
- code for training & evaluating Contextual Document Embedding modelsβ195Updated last month
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)β203Updated last year
- Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cacheβ108Updated 2 months ago
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scaleβ251Updated 2 weeks ago