Alternatives and similar repositories for datagen

Users that are interested in datagen are comparing it to the libraries listed below

• CarperAI / treasure_trove
  ☆22Updated 2 years ago
• teknium1 / transformers-gptq-quant
  ☆45Updated 2 years ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆83Updated 2 years ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆70Updated 2 years ago
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• NousResearch / StripedHyenaTrainer
  ☆62Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆49Updated 2 years ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆110Updated last year
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆20Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 2 months ago
• arcee-ai / DAM
  ☆55Updated last year
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated 2 years ago
• ChrisHayduk / QLoRA-for-MLM
  QLoRA for Masked Language Modeling
  ☆22Updated 2 years ago
• BBischof / yapping
  Verbosity control for AI agents
  ☆64Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆103Updated last year
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆30Updated last year
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 8 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated 10 months ago
• huu4ontocord / MDEL
  Multi-Domain Expert Learning
  ☆67Updated last year
• abacaj / train-with-fsdp
  ☆94Updated 2 years ago
• huggingface / peft-pytorch-conference
  Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…
  ☆14Updated 2 years ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 10 months ago
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆77Updated 4 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆71Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆32Updated 11 months ago
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆27Updated 2 years ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆107Updated 3 months ago