allenai / OLMo-coreLinks
PyTorch building blocks for the OLMo ecosystem
☆269Updated this week
Alternatives and similar repositories for OLMo-core
Users that are interested in OLMo-core are comparing it to the libraries listed below
Sorting:
- Reproducible, flexible LLM evaluations☆226Updated 3 weeks ago
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆425Updated last week
- A project to improve skills of large language models☆501Updated this week
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆344Updated 7 months ago
- A simple unified framework for evaluating LLMs☆235Updated 3 months ago
- Automatic evals for LLMs☆496Updated last month
- ☆206Updated 5 months ago
- ☆174Updated last month
- Tina: Tiny Reasoning Models via LoRA☆274Updated 2 months ago
- Decentralized RL Training at Scale☆400Updated this week
- The HELMET Benchmark☆162Updated 3 months ago
- Evaluation of LLMs on latest math competitions☆155Updated 2 weeks ago
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆119Updated 5 months ago
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆263Updated last week
- BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.☆208Updated 3 months ago
- Simple & Scalable Pretraining for Neural Architecture Research☆277Updated last week
- Benchmarking LLMs with Challenging Tasks from Real Users☆233Updated 9 months ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆190Updated last week
- Scalable toolkit for efficient model reinforcement☆558Updated this week
- Manage scalable open LLM inference endpoints in Slurm clusters☆268Updated last year
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆134Updated this week
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆306Updated last year
- The official evaluation suite and dynamic data release for MixEval.☆242Updated 8 months ago
- An extension of the nanoGPT repository for training small MOE models.☆164Updated 4 months ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆217Updated this week
- Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling☆417Updated 2 months ago
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆323Updated 3 months ago
- code for training & evaluating Contextual Document Embedding models☆196Updated 2 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆207Updated 2 months ago
- Physics of Language Models, Part 4☆204Updated last week