Alternatives and similar repositories for fineweb-2:

Users that are interested in fineweb-2 are comparing it to the libraries listed below

• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆253Updated 8 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆196Updated this week
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆109Updated last month
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆172Updated this week
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆125Updated 2 months ago
• cognitivecomputations / spectrum
  ☆113Updated 6 months ago
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆87Updated last month
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆207Updated 4 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆233Updated 4 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆176Updated 3 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆131Updated 4 months ago
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆89Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆106Updated 2 weeks ago
• DunZhang / Stella
  ☆62Updated 8 months ago
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆98Updated last month
• swj0419 / detect-pretrain-code-contamination
  ☆74Updated last year
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆75Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆218Updated 4 months ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆206Updated 10 months ago
• THUDM / ComplexFuncBench
  Complex Function Calling Benchmark.
  ☆85Updated 2 months ago
• yifanzhang-pro / AutoMathText
  Official implementation of paper "Autonomous Data Selection with Language Models for Mathematical Texts" (As Huggingface Daily Papers: ht…
  ☆80Updated 4 months ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆193Updated this week
• jakespringer / echo-embeddings
  ☆142Updated 11 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆75Updated 6 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆71Updated 7 months ago
• AIR-Bench / AIR-Bench
  AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆133Updated 3 months ago
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆39Updated last month
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆213Updated 4 months ago
• SALT-NLP / demonstrated-feedback
  ☆119Updated 5 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆73Updated 5 months ago