Alternatives and similar repositories for llm-decontaminator:

Users that are interested in llm-decontaminator are comparing it to the libraries listed below

• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆247Updated 6 months ago
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆382Updated 9 months ago
• huggingface / cosmopedia
  ☆484Updated last month
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆204Updated 7 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆164Updated 3 weeks ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆330Updated 3 months ago
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆447Updated 9 months ago
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆122Updated last year
• NVIDIA / NeMo-Skills
  A project to improve skills of large language models
  ☆230Updated this week
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆233Updated 2 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆315Updated 9 months ago
• HKUNLP / ChunkLlama
  [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"
  ☆377Updated 3 months ago
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆184Updated 5 months ago
• mlfoundations / open_lm
  A repository for research on medium sized language models.
  ☆484Updated this week
• deepseek-ai / ESFT
  Expert Specialized Fine-Tuning
  ☆167Updated 3 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆206Updated 2 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆197Updated 2 months ago
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆491Updated last week
• LLM360 / amber-train
  Pre-training code for Amber 7B LLM
  ☆160Updated 8 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆118Updated last month
• OpenBMB / InfiniteBench
  Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718
  ☆303Updated 3 months ago
• bigcode-project / selfcodealign
  [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation
  ☆287Updated 2 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆425Updated last week
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆153Updated 3 months ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆178Updated last month
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆164Updated 2 months ago
• LiveCodeBench / LiveCodeBench
  Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
  ☆273Updated this week
• NVlabs / Minitron
  A family of compressed models obtained via pruning and knowledge distillation
  ☆309Updated 2 months ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆242Updated 9 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆430Updated 7 months ago