Alternatives and similar repositories for dpo-lora:

Users that are interested in dpo-lora are comparing it to the libraries listed below

• matttreed / diloco-sim
  ☆11Updated last week
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆60Updated 8 months ago
• teknium1 / RawTransform
  A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.
  ☆30Updated last year
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆72Updated last year
• EleutherAI / steering-llama3
  ☆24Updated 5 months ago
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆26Updated last month
• InflectionAI / Inflection-Benchmarks
  Public Inflection Benchmarks
  ☆69Updated 10 months ago
• JacobPfau / fillerTokens
  ☆58Updated 8 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 3 months ago
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆182Updated 7 months ago
• enjalot / fineweb-modal
  Using modal.com to process FineWeb-edu data
  ☆19Updated last month
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆82Updated 3 months ago
• doomslide / autoloom
  ☆20Updated 2 months ago
• xjdr-alt / muzero_sketch
  ☆37Updated 5 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated 9 months ago
• 1rgs / token-trekker-rs
  ☆13Updated last year
• MNoorFawi / curlora
  The code repository for the CURLoRA research paper. Stable LLM continual fine-tuning and catastrophic forgetting mitigation.
  ☆41Updated 4 months ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated last year
• thesephist / spectre
  Sparse autoencoders for Contra text embedding models
  ☆25Updated 8 months ago
• HazyResearch / train-tk
  train with kittens!
  ☆52Updated 2 months ago
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆46Updated 7 months ago
• sfcompute / tinynarrations
  A synthetic story narration dataset to study small audio LMs.
  ☆31Updated 11 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 9 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆43Updated 8 months ago
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated 7 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• 0hq / chessgpt
  ☆18Updated last year
• amudide / switch_sae
  Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)
  ☆16Updated last month