Alternatives and similar repositories for TranformersGetStable:

Users that are interested in TranformersGetStable are comparing it to the libraries listed below

• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆30Updated 10 months ago
• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆16Updated 5 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆16Updated 2 months ago
• Eliyas0007 / Pytorch-Intention
  Unofficial implementation of paper : Exploring the Space of Key-Value-Query Models with Intention
  ☆11Updated last year
• sustcsonglin / gated_linear_attention_layer
  ☆32Updated last year
• stan-anony / derivative_free_lora_rank
  ☆16Updated last year
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 8 months ago
• juzhengz / LoRI
  Official PyTorch implementation of LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation.
  ☆13Updated 2 weeks ago
• ducdauge / sft-llm
  Scaling Sparse Fine-Tuning to Large Language Models
  ☆16Updated last year
• formll / resolving-scaling-law-discrepancies
  ☆18Updated 9 months ago
• linkedin / ControlLLM
  Control LLM
  ☆14Updated 2 weeks ago
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated last year
• lucidrains / transformer-lm-gan
  Explorations into adversarial losses on top of autoregressive loss for language modeling
  ☆35Updated 2 months ago
• yale-nlp / refdpo
  ☆16Updated 9 months ago
• thunlp / SparsingLaw
  The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".
  ☆20Updated 5 months ago
• RE-N-Y / sae
  ☆14Updated 5 months ago
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 9 months ago
• jongwooko / distillm-2
  ☆9Updated last month
• bdusell / stack-attention
  Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"
  ☆17Updated last year
• Yuanhy1997 / HyPe
  HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]
  ☆14Updated last year
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆25Updated 5 months ago
• scalable-model-editing / unified-model-editing
  We introduce EMMET and unify model editing with popular algorithms ROME and MEMIT.
  ☆17Updated 4 months ago
• Picsart-AI-Research / Social-Reward
  ☆10Updated last year
• MIO-Team / MIO
  MIO: A Foundation Model on Multimodal Tokens
  ☆25Updated 4 months ago
• juyongjiang / KaSA
  [ICLR'25] Code for KaSA, an official implementation of "KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Models"
  ☆11Updated 3 months ago
• nreHieW / minVAR
  Minimal Implementation of Visual Autoregressive Modelling (VAR)
  ☆30Updated last month
• kazuki-irie / kv-memory-brain
  Official Code Repository for the paper "Key-value memory in the brain"
  ☆24Updated 2 months ago
• hamishivi / tess-2
  Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"
  ☆34Updated 2 months ago
• bentherien / mu_learned_optimization
  [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
  ☆12Updated last month
• rtaori / data_feedback
  Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"
  ☆15Updated 2 years ago