Alternatives and similar repositories for epochraft:

Users that are interested in epochraft are comparing it to the libraries listed below

• cat-state / tinypar
  ☆20Updated last year
• iwiwi / epochraft-hf-fsdp
  Example of using Epochraft to train HuggingFace transformers models with PyTorch FSDP
  ☆12Updated last year
• kotoba-tech / kotomamba
  Mamba training library developed by kotoba technologies
  ☆67Updated last year
• huggingface / peft-pytorch-conference
  Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…
  ☆14Updated last year
• kotoba-tech / kotoba-recipes
  Support Continual pre-training & Instruction Tuning forked from llama-recipes
  ☆31Updated last year
• hadasah / btm
  ☆72Updated 9 months ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• turingmotors / vlm-recipes
  ☆15Updated 5 months ago
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated 2 years ago
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated last year
• hitachi-nlp / FLD-corpus
  ☆15Updated 2 months ago
• Aratako / Task-Vector-Merge-Optimzier
  ☆14Updated 10 months ago
• RobertCsordas / moe_layer
  sigma-MoE layer
  ☆18Updated last year
• jungokasai / beam_with_patience
  ☆46Updated 2 years ago
• nlp-waseda / JMMLU
  日本語マルチタスク言語理解ベンチマーク Japanese Massive Multitask Language Understanding Benchmark
  ☆32Updated 2 months ago
• ahennequ / pytorch-custom-mma
  ☆29Updated 2 years ago
• yoichi1484 / subspace
  An implementation of "Subspace Representations for Soft Set Operations and Sentence Similarities" (NAACL 2024)
  ☆10Updated 8 months ago
• lighttransport / japanese-llama-experiment
  Japanese LLaMa experiment
  ☆52Updated 2 months ago
• allenai / sso
  Repository for Skill Set Optimization
  ☆12Updated 6 months ago
• KanHatakeyama / synthetic-texts-by-llm
  ☆25Updated 3 months ago
• rinnakk / prefix-tuning-gpt
  Example code for prefix-tuning GPT/GPT-NeoX models and for inference with trained prefixes
  ☆12Updated last year
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆48Updated 3 years ago
• llm-jp / llm-jp-sft
  ☆58Updated 8 months ago
• srush / LLM-Talk
  ☆48Updated last year
• yikangshen / megablocks
  ☆18Updated 8 months ago
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆35Updated last year
• kyo-takano / chinchilla
  A toolkit for scaling law research ⚖
  ☆47Updated 3 weeks ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• bentherien / mu_learned_optimization
  [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
  ☆11Updated 2 months ago