Alternatives and similar repositories for OLMo-core

Users that are interested in OLMo-core are comparing it to the libraries listed below

• NVIDIA-NeMo / Skills
  A project to improve skills of large language models
  ☆628Updated this week
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆293Updated 2 weeks ago
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆559Updated 5 months ago
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆576Updated last month
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆360Updated 11 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆215Updated 8 months ago
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆561Updated 2 months ago
• allenai / OLMoE
  OLMoE: Open Mixture-of-Experts Language Models
  ☆919Updated 2 months ago
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆322Updated this week
• changjonathanc / flex-nano-vllm
  FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.
  ☆313Updated last month
• huggingface / picotron_tutorial
  ☆224Updated last week
• huggingface / cosmopedia
  ☆556Updated last year
• huggingface / fineweb-2
  ☆209Updated last month
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆309Updated 2 months ago
• PrimeIntellect-ai / prime-rl
  Async RL Training at Scale
  ☆909Updated this week
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆315Updated last year
• NVIDIA-NeMo / RL
  Scalable toolkit for efficient model reinforcement
  ☆1,054Updated this week
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆257Updated this week
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆277Updated last year
• marin-community / marin
  Open-source framework for the research and development of foundation models.
  ☆648Updated this week
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆145Updated 10 months ago
• thinking-machines-lab / batch_invariant_ops
  ☆917Updated last month
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆265Updated this week
• NVIDIA / NeMo-Aligner
  Scalable toolkit for efficient model alignment
  ☆847Updated 2 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆254Updated 7 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆349Updated 7 months ago
• QwenLM / ParScale
  Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling
  ☆460Updated 6 months ago
• microsoft / LongRoPE
  LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.
  ☆273Updated last month
• NVlabs / Minitron
  A family of compressed models obtained via pruning and knowledge distillation
  ☆359Updated last month
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,118Updated 6 months ago