allenai / OLMo-coreLinks
PyTorch building blocks for the OLMo ecosystem
β258Updated this week
Alternatives and similar repositories for OLMo-core
Users that are interested in OLMo-core are comparing it to the libraries listed below
Sorting:
- Reproducible, flexible LLM evaluationsβ219Updated this week
- πΎ OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.β404Updated this week
- β160Updated 2 weeks ago
- A project to improve skills of large language modelsβ456Updated this week
- A simple unified framework for evaluating LLMsβ221Updated 3 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, sparsβ¦β341Updated 7 months ago
- β198Updated 5 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"β306Updated last year
- BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.β203Updated 2 months ago
- The official evaluation suite and dynamic data release for MixEval.β242Updated 8 months ago
- Evaluation of LLMs on latest math competitionsβ140Updated 2 months ago
- The HELMET Benchmarkβ156Updated 2 months ago
- An extension of the nanoGPT repository for training small MOE models.β160Updated 4 months ago
- Automatic evals for LLMsβ461Updated 2 weeks ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".β206Updated last month
- Benchmarking LLMs with Challenging Tasks from Real Usersβ228Updated 8 months ago
- Manage scalable open LLM inference endpoints in Slurm clustersβ265Updated last year
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).β259Updated 3 weeks ago
- code for training & evaluating Contextual Document Embedding modelsβ194Updated 2 months ago
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.β129Updated this week
- Tina: Tiny Reasoning Models via LoRAβ266Updated last month
- prime-rl is a codebase for decentralized async RL training at scaleβ368Updated this week
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learningβ207Updated this week
- β259Updated this week
- Scalable toolkit for efficient model reinforcementβ499Updated this week
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"β243Updated 5 months ago
- Accelerating your LLM training to full speed! Made with β€οΈ by ServiceNow Researchβ211Updated this week
- β181Updated 2 months ago
- LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.β232Updated 10 months ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)β156Updated this week