Alternatives and similar repositories for GENIUS

Users that are interested in GENIUS are comparing it to the libraries listed below

• ctlllll / reward_collapse
  ☆27Updated 2 years ago
• microsoft / AutoMoE
  AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  ☆48Updated 3 years ago
• song-wx / SIFT
  [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely
  ☆24Updated last year
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 8 months ago
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆49Updated 2 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆81Updated 2 years ago
• katiekang1998 / reasoning_generalization
  ☆33Updated 11 months ago
• kyegomez / EAOT
  The open source implementation of "Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers"
  ☆19Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆56Updated 2 years ago
• HayeonLee / MetaD2A
  Official PyTorch implementation of "Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets" (ICLR 2021)
  ☆64Updated last year
• aszala / EnvGen
  Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)
  ☆39Updated last year
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆56Updated 10 months ago
• TNAS-DCS / TNAS-DCS
  ☆13Updated 3 years ago
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆37Updated 2 years ago
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆46Updated 2 years ago
• jysohn1108 / Looped-Transformer
  Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…
  ☆29Updated 2 years ago
• duterscmy / CD-MoE
  Official PyTorch implementation of CD-MOE
  ☆12Updated 8 months ago
• VITA-Group / o1-planning
  [NeurIPS'24 LanGame workshop] On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability
  ☆41Updated 5 months ago
• Infini-AI-Lab / GRESO
  ☆70Updated 5 months ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆32Updated last year
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆30Updated last year
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆81Updated 2 years ago
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆26Updated last year
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆40Updated last year
• gregorbachmann / Next-Token-Failures
  ☆107Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated 2 years ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆47Updated last year
• IdoAmos / not-from-scratch
  ☆33Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated 2 years ago
• martin-wey / CodeUltraFeedback
  CodeUltraFeedback: aligning large language models to coding preferences (TOSEM 2025)
  ☆73Updated last year