Alternatives and similar repositories for dreamshard:

Users that are interested in dreamshard are comparing it to the libraries listed below

• daochenzha / autoshard
  [KDD 2022] AutoShard: Automated Embedding Table Sharding for Recommender Systems
  ☆21Updated 2 years ago
• daochenzha / neuroshard
  [MLSys 2023] Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models
  ☆16Updated 2 years ago
• NUS-HPC-AI-Lab / Helen
  The official implementation of "Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization"
  ☆16Updated last year
• noveens / distill_cf
  [ NeurIPS '22 ] Data distillation for recommender systems. Shows equivalent performance with 2-3 orders less data.
  ☆23Updated last year
• IdoAmos / not-from-scratch
  ☆31Updated 6 months ago
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆33Updated last year
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆30Updated 10 months ago
• mingkai-zheng / GENIUS
  Can GPT-4 Perform Neural Architecture Search?
  ☆87Updated last year
• wolfecameron / GIST
  Repository for "GIST: Distributed training for large-scale graph convolutional networks"
  ☆14Updated 2 years ago
• rutgerswiselab / AutoLossGen
  AutoLossGen: Automatic Loss Function Generation for Recommender Systems
  ☆22Updated 3 years ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆43Updated 7 months ago
• TNAS-DCS / TNAS-DCS
  ☆13Updated 2 years ago
• wangskyGit / passage-sieve
  official repo of AAAI2024 paper Mitigating the Impact of False Negatives in Dense Retrieval with Contrastive Confidence Regularization
  ☆13Updated last year
• nilesh2797 / ELIAS
  Official codebase for NeurIPS 2022 paper End-to-end Learning to Index and Search in Large Output Spaces
  ☆12Updated 2 years ago
• microsoft / AutoMoE
  AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  ☆46Updated 2 years ago
• uservan / ThinkPO
  ☆20Updated 2 months ago
• aoiang / LaMOO
  ☆29Updated 2 years ago
• CEC-Agent / CEC
  Official Implementation of NeurIPS'23 Paper "Cross-Episodic Curriculum for Transformer Agents"
  ☆31Updated last year
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆23Updated 2 months ago
• jparkerholder / PB2
  Code for the Population-Based Bandits Algorithm, presented at NeurIPS 2020.
  ☆20Updated 4 years ago
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆26Updated 7 months ago
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated 2 years ago
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆19Updated last month
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆16Updated 3 months ago
• Doraemonzzz / hgru2-pytorch
  ☆23Updated 7 months ago
• schwartz-lab-NLP / papa
  Code for the PAPA paper
  ☆27Updated 2 years ago
• devnkong / VQ-GNN
  Official implementation of our VQ-GNN paper (NeurIPS2021)
  ☆38Updated 3 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• Ying1123 / llm-caching-multiplexing
  ☆20Updated last year
• HazyResearch / prefix-linear-attention
  ☆53Updated 9 months ago