Alternatives and similar repositories for OLMo-core

Users that are interested in OLMo-core are comparing it to the libraries listed below

• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆244Updated 2 months ago
• NVIDIA / NeMo-Skills
  A project to improve skills of large language models
  ☆553Updated this week
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆343Updated 9 months ago
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆459Updated 3 weeks ago
• huggingface / picotron_tutorial
  ☆216Updated 7 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆185Updated 6 months ago
• eth-sri / matharena
  Evaluation of LLMs on latest math competitions
  ☆162Updated last month
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆243Updated 5 months ago
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆291Updated 3 weeks ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆271Updated last year
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆309Updated last year
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆245Updated 10 months ago
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆524Updated 2 months ago
• marin-community / marin
  Open-source framework for the research and development of foundation models.
  ☆419Updated last week
• huggingface / fineweb-2
  ☆188Updated 2 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆241Updated 10 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆284Updated last week
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆281Updated last month
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆210Updated this week
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆140Updated last week
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆122Updated 7 months ago
• QwenLM / ParScale
  Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling
  ☆443Updated 3 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆215Updated last month
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆524Updated 2 months ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆211Updated last week
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆171Updated last month
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆225Updated 2 months ago
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆209Updated 3 months ago
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆268Updated 4 months ago
• changjonathanc / flex-nano-vllm
  FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.
  ☆269Updated last month