Alternatives and similar repositories for NeMo-Skills

Users that are interested in NeMo-Skills are comparing it to the libraries listed below

• NVIDIA / NeMo-Aligner
  Scalable toolkit for efficient model alignment
  ☆803Updated 2 weeks ago
• NVIDIA / NeMo-RL
  Scalable toolkit for efficient model reinforcement
  ☆361Updated this week
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆367Updated last week
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆203Updated 3 weeks ago
• huggingface / Math-Verify
  ☆731Updated last month
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆222Updated this week
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆461Updated last year
• NovaSky-AI / SkyRL
  SkyRL-v0: Train Real-World Long-Horizon Agents via Reinforcement Learning
  ☆343Updated last week
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆582Updated this week
• HKUNLP / ChunkLlama
  [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"
  ☆410Updated 7 months ago
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆353Updated 8 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆333Updated 5 months ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆302Updated last year
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆245Updated this week
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆725Updated 8 months ago
• eddycmu / demystify-long-cot
  ☆293Updated this week
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆301Updated 3 weeks ago
• OpenBMB / InfiniteBench
  Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718
  ☆326Updated 8 months ago
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆417Updated last year
• huggingface / cosmopedia
  ☆517Updated 6 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆248Updated this week
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆249Updated this week
• knoveleng / open-rs
  Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"
  ☆231Updated 3 weeks ago
• xfactlab / orpo
  Official repository for ORPO
  ☆453Updated last year
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆399Updated this week
• NVlabs / Minitron
  A family of compressed models obtained via pruning and knowledge distillation
  ☆341Updated 6 months ago
• microsoft / rStar
  ☆554Updated last month
• huggingface / picotron_tutorial
  ☆188Updated 3 months ago
• microsoft / LongRoPE
  LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.
  ☆228Updated 9 months ago
• QwenLM / AutoIF
  ☆282Updated 10 months ago