Alternatives and similar repositories for transformer-birth

Users that are interested in transformer-birth are comparing it to the libraries listed below

• r-three / mats
  ☆30Updated 10 months ago
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆76Updated last year
• shauli-ravfogel / rlace-icml
  ☆36Updated 2 years ago
• aw31 / empirical-ntks
  Efficient empirical NTKs in PyTorch
  ☆18Updated 2 years ago
• berlino / seq_icl
  ☆52Updated 11 months ago
• pilancilab / Riemannian_Preconditioned_LoRA
  source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"
  ☆24Updated 10 months ago
• sjelassi / transformers_ssm_copy
  ☆31Updated last year
• adamxyang / laplace-lora
  Bayesian low-rank adaptation for large language models
  ☆23Updated last year
• DeqingFu / transformers-icl-second-order
  Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…
  ☆16Updated 6 months ago
• locuslab / edge-of-stability
  ☆67Updated 5 months ago
• sustcsonglin / gated_linear_attention_layer
  ☆32Updated last year
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆27Updated last year
• UW-Madison-Lee-Lab / Expressive_Power_of_LoRA
  Code for "The Expressive Power of Low-Rank Adaptation".
  ☆20Updated last year
• RobertCsordas / ndr
  The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
  ☆33Updated 3 years ago
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated last year
• jiahai-feng / binding-iclr
  ☆14Updated last year
• KihoPark / linear_rep_geometry
  ☆93Updated 3 months ago
• IdoAmos / not-from-scratch
  ☆31Updated 6 months ago
• formll / resolving-scaling-law-discrepancies
  ☆19Updated 10 months ago
• Kaleidophon / nlp-uncertainty-zoo
  Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.
  ☆53Updated 2 years ago
• mmatena / model_merging
  ☆66Updated 3 years ago
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆37Updated 2 years ago
• allenbai01 / transformers-as-statisticians
  ☆31Updated last year
• sustcsonglin / mamba-triton
  ☆47Updated last year
• RobertCsordas / modules
  The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…
  ☆46Updated last year
• nouhadziri / faith-and-fate
  ☆33Updated last year
• Liuhong99 / implicitbiasmlmcode
  ☆11Updated 2 years ago
• bartbussmann / matryoshka_sae
  ☆33Updated 4 months ago
• wzq016 / PINE
  Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""
  ☆14Updated 8 months ago
• peterljq / Parsimonious-Concept-Engineering
  PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆35Updated 6 months ago