cccntu / LoRAnanoGPT

Related projects ⓘ

Alternatives and complementary repositories for LoRAnanoGPT

• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated 8 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 7 months ago
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆15Updated 2 weeks ago
• euclaise / supertrainer2000
  ☆49Updated 7 months ago
• CERC-AAI / Robin
  ☆62Updated last month
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆36Updated 7 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆39Updated 3 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆15Updated last week
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated 11 months ago
• GreenBitAI / bitorch-engine
  A toolkit enhances PyTorch with specialized functions for low-bit quantized neural networks.
  ☆28Updated 4 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆74Updated 5 months ago
• facebookresearch / dual-system-for-visual-language-reasoning
  Github repo for Peifeng's internship project
  ☆12Updated last year
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆19Updated 4 months ago
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated last year
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆20Updated last week
• catid / lllm
  Latent Large Language Models
  ☆16Updated 2 months ago
• Zyphra / Zyda_processing
  ☆26Updated 4 months ago
• RyokoAI / BigKnow2022
  BigKnow2022: Bringing Language Models Up to Speed
  ☆14Updated last year
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆55Updated 2 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆16Updated last week
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆46Updated 7 months ago
• sekstini / basedxl
  ☆15Updated 7 months ago
• YerbaPage / MGDebugger
  From Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical Debugging
  ☆52Updated last month
• catid / spectral_ssm
  Implementation of Spectral State Space Models
  ☆17Updated 8 months ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆20Updated this week
• ConiferLabsWA / flan-ul2-alpaca
  ☆32Updated last year
• CarperAI / treasure_trove
  ☆22Updated last year
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆29Updated 3 weeks ago