Alternatives and similar repositories for focus

Users that are interested in focus are comparing it to the libraries listed below

• ekinakyurek / google-research
  Google Research
  ☆46Updated 2 years ago
• jxbz / entropix
  📰 Computing the information content of trained neural networks
  ☆22Updated 4 years ago
• hadasah / btm
  ☆76Updated last year
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated last year
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆59Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆38Updated 4 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆63Updated last year
• mlfoundations / dataset2metadata
  ☆26Updated last year
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated 2 years ago
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆114Updated last year
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆78Updated 2 years ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆25Updated 10 months ago
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 3 years ago
• KaiNylund / lm-weights-encode-time
  ☆69Updated last year
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆89Updated last year
• prateeky2806 / ComPEFT
  ☆26Updated last year
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆39Updated 11 months ago
• RAIVNLab / MatFormer-OLMo
  Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…
  ☆28Updated last year
• shauli-ravfogel / rlace-icml
  ☆36Updated 3 years ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆31Updated 2 years ago
• EleutherAI / semantic-memorization
  ☆44Updated 10 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆43Updated 11 months ago
• guy-dar / embedding-space
  ☆54Updated 2 years ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated 2 years ago
• microsoft / AutoMoE
  AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  ☆47Updated 2 years ago
• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆97Updated 2 years ago
• locuslab / scaling_laws_data_filtering
  ☆65Updated last year
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated 2 years ago
• stanford-crfm / helm-efficiency
  ☆10Updated last year
• shoaibahmed / metadata_archaeology
  Official code for the paper: "Metadata Archaeology"
  ☆19Updated 2 years ago