Alternatives and similar repositories for LoRAnanoGPT:

Users that are interested in LoRAnanoGPT are comparing it to the libraries listed below

• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• lucidrains / transformer-lm-gan
  Explorations into adversarial losses on top of autoregressive loss for language modeling
  ☆35Updated 2 months ago
• huggingface / pixparse
  Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data
  ☆21Updated 9 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 6 months ago
• euclaise / supertrainer2000
  ☆49Updated last year
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated 11 months ago
• crypdick / timm-lr-scheduler-explorer
  A dashboard for exploring timm learning rate schedulers
  ☆19Updated 5 months ago
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated 8 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 9 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆37Updated last year
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 7 months ago
• cloneofsimo / fim-llama-deepspeed
  ☆31Updated last year
• LLM360 / k2-data-prep
  ☆20Updated 11 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• Narsil / bloomserver
  ☆39Updated 2 years ago
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆42Updated 5 months ago
• data2ml / all-clip
  Load any clip model with a standardized interface
  ☆21Updated last year
• Zyphra / Zyda_processing
  ☆33Updated 10 months ago
• catid / lllm
  Latent Large Language Models
  ☆18Updated 8 months ago
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆20Updated 10 months ago
• catid / spectral_ssm
  Implementation of Spectral State Space Models
  ☆16Updated last year
• LAION-AI / riverbed
  Tools for content datamining and NLP at scale
  ☆43Updated 10 months ago
• brianfitzgerald / smolmodels
  Collection of experiments related to small language models, mostly seq2seq models
  ☆11Updated last week
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 3 months ago
• The-Inscrutable-X / TACQ
  Official Repository for Task-Circuit Quantization
  ☆19Updated last week
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• facebookresearch / dual-system-for-visual-language-reasoning
  Github repo for Peifeng's internship project
  ☆14Updated last year
• EleutherAI / training-jacobian
  ☆21Updated 4 months ago
• cloneofsimo / zeroshampoo
  ☆33Updated 7 months ago