Alternatives and similar repositories for focus:

Users that are interested in focus are comparing it to the libraries listed below

• ekinakyurek / google-research
  Google Research
  ☆46Updated 2 years ago
• EleutherAI / semantic-memorization
  ☆44Updated 5 months ago
• hadasah / btm
  ☆72Updated last year
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• prateeky2806 / ComPEFT
  ☆25Updated last year
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆24Updated 5 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 3 months ago
• ethz-spylab / superhuman-ai-consistency
  ☆29Updated last year
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 7 months ago
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated 2 years ago
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆36Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆37Updated last year
• facebookresearch / concurrentqa
  This repo contains data and code for the paper "Reasoning over Public and Private Data in Retrieval-Based Systems."
  ☆46Updated 9 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 3 years ago
• jxbz / entropix
  📰 Computing the information content of trained neural networks
  ☆21Updated 3 years ago
• nyu-mll / ILF-for-code-generation
  ☆75Updated last month
• codekansas / rwkv
  RWKV model implementation
  ☆37Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆43Updated 7 months ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆27Updated last year
• mlfoundations / dataset2metadata
  ☆24Updated last year
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆23Updated last week
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆19Updated last month
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆38Updated last year
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆84Updated last year
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆39Updated 5 months ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆25Updated 3 months ago
• IBM / model-recycling
  Ranking of fine-tuned HF models as base models.
  ☆35Updated this week