apple / ml-hypercloningLinks
☆50Updated 10 months ago
Alternatives and similar repositories for ml-hypercloning
Users that are interested in ml-hypercloning are comparing it to the libraries listed below
Sorting:
- Collection of autoregressive model implementation☆86Updated 4 months ago
- ☆46Updated last year
- ☆82Updated last year
- some common Huggingface transformers in maximal update parametrization (µP)☆82Updated 3 years ago
- MatFormer repo☆62Updated 9 months ago
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆87Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆95Updated this week
- ☆58Updated 4 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated 11 months ago
- Train, tune, and infer Bamba model☆132Updated 3 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆201Updated last year
- Google TPU optimizations for transformers models☆120Updated 7 months ago
- A repository for research on medium sized language models.☆77Updated last year
- ☆102Updated last month
- PyTorch implementation of models from the Zamba2 series.☆185Updated 7 months ago
- ☆48Updated last year
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆128Updated last year
- ☆69Updated last year
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆129Updated 9 months ago
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆161Updated 5 months ago
- Implementation of the Llama architecture with RLHF + Q-learning☆166Updated 7 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆101Updated 8 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆160Updated 2 months ago
- ☆54Updated 10 months ago
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated last year
- Experiments for efforts to train a new and improved t5☆76Updated last year
- Triton Implementation of HyperAttention Algorithm☆48Updated last year
- ☆49Updated last year