joey00072 / TinyLora

Related projects ⓘ

Alternatives and complementary repositories for TinyLora

• CarperAI / treasure_trove
  ☆22Updated last year
• huggingface / peft-pytorch-conference
  Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…
  ☆14Updated last year
• YuchenJin / llm.c
  LLM training in simple, raw C/CUDA
  ☆12Updated last month
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆43Updated this week
• joey00072 / microjax
  Jax like function transformation engine but micro, microjax
  ☆26Updated 2 weeks ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆15Updated last week
• arcee-ai / DAM
  ☆38Updated this week
• pacman100 / peft-codegen-25
  ☆24Updated last year
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated 9 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated 8 months ago
• qnguyen3 / hermes-llava
  ☆54Updated 10 months ago
• euclaise / supertrainer2000
  ☆49Updated 7 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆20Updated last week
• kyegomez / SelfExtend
  Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta
  ☆13Updated this week
• modal-labs / ci-on-modal
  A sample pattern for running CI tests on Modal
  ☆13Updated last month
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆25Updated last year
• attashe / ModifiedBeamSampler
  Modified Beam Search with periodical restart
  ☆12Updated last month
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆45Updated last year
• NousResearch / StripedHyenaTrainer
  ☆55Updated 11 months ago
• sytelus / pcprep
  Scripts to prep PC for development use after OS installs
  ☆37Updated this week
• Aleph-Alpha / trigrams
  ☆44Updated 2 months ago
• ChrisHayduk / QLoRA-for-MLM
  QLoRA for Masked Language Modeling
  ☆20Updated last year
• diicellman / dynamite-dogs
  BH hackathon
  ☆14Updated 7 months ago
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated 9 months ago
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆67Updated last year
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆19Updated 4 months ago
• kyegomez / Kosmos-X
  The Next Generation Multi-Modality Superintelligence
  ☆70Updated 2 months ago
• cloneofsimo / zeroshampoo
  ☆31Updated 2 months ago