Alternatives and similar repositories for dpo-lora:

Users that are interested in dpo-lora are comparing it to the libraries listed below

• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 10 months ago
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆31Updated last month
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• menhguin / minp_paper
  Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper
  ☆28Updated 2 weeks ago
• InflectionAI / Inflection-Benchmarks
  Public Inflection Benchmarks
  ☆68Updated last year
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆74Updated last year
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 4 months ago
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆56Updated last week
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆63Updated last year
• CERC-AAI / Robin
  ☆63Updated 6 months ago
• matttreed / diloco-sim
  ☆16Updated 2 months ago
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆59Updated 10 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated last month
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆84Updated 5 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 11 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆91Updated 3 weeks ago
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆54Updated last year
• doomslide / autoloom
  ☆20Updated 4 months ago
• JacobPfau / fillerTokens
  ☆60Updated 11 months ago
• MNoorFawi / curlora
  The code repository for the CURLoRA research paper. Stable LLM continual fine-tuning and catastrophic forgetting mitigation.
  ☆43Updated 7 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆82Updated last year
• ahstat / episodic-memory-benchmark
  Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…
  ☆37Updated this week
• PrimeIntellect-ai / INTELLECT-MATH
  A 7B parameter model for mathematical reasoning
  ☆23Updated last month
• ivanleomk / modal-grpo
  ☆17Updated 2 weeks ago
• teknium1 / RawTransform
  A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.
  ☆30Updated last year
• sfcompute / tinynarrations
  A synthetic story narration dataset to study small audio LMs.
  ☆32Updated last year
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• Columbia-NLP-Lab / PAPILLON
  Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles
  ☆22Updated 3 months ago
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated 10 months ago