Alternatives and similar repositories for pretrain-data

Users that are interested in pretrain-data are comparing it to the libraries listed below

• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆170Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 10 months ago
• QuixiAI / kraken
  ☆67Updated last year
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆103Updated 5 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 7 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆66Updated last year
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆146Updated 7 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆263Updated 9 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆177Updated last year
• CERC-AAI / Robin
  ☆63Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• QuixiAI / spectrum
  ☆135Updated last month
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆109Updated 5 months ago
• kyutai-labs / dactory
  ☆42Updated 2 weeks ago
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆28Updated last year
• facebookresearch / ExploreToM
  Code for ExploreTom
  ☆86Updated 3 months ago
• Aleph-Alpha-Research / trigrams
  ☆58Updated 4 months ago
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆116Updated last month
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆62Updated 4 months ago
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆52Updated last month
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆94Updated this week
• Aleph-Alpha-Research / scaling
  Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…
  ☆65Updated 10 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 9 months ago
• huggingface / competitions
  ☆124Updated 10 months ago
• huggingface / fineweb-2
  ☆194Updated 2 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆185Updated 8 months ago
• writer / writing-in-the-margins
  ☆119Updated last year
• neoxelox / dspy-inspector
  DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.
  ☆40Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆132Updated 3 months ago