Alternatives and similar repositories for focus:

Users that are interested in focus are comparing it to the libraries listed below

• ekinakyurek / google-research
  Google Research
  ☆46Updated 2 years ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• ethz-spylab / superhuman-ai-consistency
  ☆29Updated last year
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆21Updated 4 months ago
• jxbz / entropix
  📰 Computing the information content of trained neural networks
  ☆21Updated 3 years ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• rtaori / data_feedback
  Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"
  ☆15Updated 2 years ago
• microsoft / AutoMoE
  AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  ☆45Updated 2 years ago
• amudide / switch_sae
  Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)
  ☆21Updated 4 months ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆30Updated last year
• EleutherAI / training-jacobian
  ☆21Updated 4 months ago
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆39Updated 4 months ago
• facebookresearch / coder_reviewer_reranking
  Official code release for the paper Coder Reviewer Reranking for Code Generation.
  ☆42Updated 2 years ago
• ctlllll / reward_collapse
  ☆27Updated last year
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆24Updated this week
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆18Updated last month
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆44Updated 2 years ago
• tianyu139 / meaning-as-trajectories
  Official PyTorch Implementation for Meaning Representations from Trajectories in Autoregressive Models (ICLR 2024)
  ☆20Updated 11 months ago
• snu-mllab / Neural-Relation-Graph
  Official PyTorch implementation of "Neural Relation Graph: A Unified Framework for Identifying Label Noise and Outlier Data" (NeurIPS'23)
  ☆15Updated last year
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 6 months ago
• mlfoundations / dataset2metadata
  ☆24Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆43Updated 6 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆23Updated 3 months ago
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 2 years ago
• formll / resolving-scaling-law-discrepancies
  ☆18Updated 9 months ago
• prateeky2806 / ComPEFT
  ☆25Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• hadasah / btm
  ☆72Updated 11 months ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆27Updated last year
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year