aws-neuron / aws-neuron-reference-for-megatron-lm
☆14Updated last year
Alternatives and similar repositories for aws-neuron-reference-for-megatron-lm:
Users that are interested in aws-neuron-reference-for-megatron-lm are comparing it to the libraries listed below
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- Helper scripts and notes that were used while porting various nlp models☆46Updated 3 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]☆14Updated last year
- ☆35Updated 4 months ago
- See https://github.com/cuda-mode/triton-index/ instead!☆11Updated last year
- ☆12Updated 3 years ago
- Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval☆14Updated last year
- ☆17Updated last year
- ☆16Updated 5 years ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆19Updated 3 months ago
- ☆14Updated 2 years ago
- ☆22Updated last year
- Transformers at any scale☆41Updated last year
- Analogous Safe-state Exploration (ASE) is an algorithm for provably safe and optimal exploration in MDPs with unknown, stochastic dynamic…☆11Updated 4 years ago
- A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering☆16Updated 2 years ago
- ☆13Updated 3 years ago
- ☆14Updated 7 months ago
- [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators☆24Updated last year
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 11 months ago
- ☆13Updated 2 months ago
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- Resources accompanying the "Zero-Shot Recommendation as Language Modeling" paper (ECIR2022)☆13Updated last year
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- Learning to Model Editing Processes☆26Updated 2 years ago
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆30Updated 2 weeks ago
- Code for "Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking" (https://arxiv.org/abs/2…☆14Updated 2 years ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated 2 weeks ago
- interactive explorer for language models☆9Updated 5 years ago
- Embedding Recycling for Language models☆38Updated last year