Transformers at any scale
☆42Jan 18, 2024Updated 2 years ago
Alternatives and similar repositories for torchscale
Users that are interested in torchscale are comparing it to the libraries listed below
Sorting:
- Code for the paper "Modelling Latent Translations for Cross-Lingual Transfer"☆17Nov 22, 2021Updated 4 years ago
- ☆14Apr 8, 2021Updated 4 years ago
- Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"☆18Mar 15, 2024Updated last year
- Code for the ACL 2017 paper "Get To The Point: Summarization with Pointer-Generator Networks"☆13Jul 5, 2017Updated 8 years ago
- Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation☆15Aug 27, 2024Updated last year
- Code for NeurIPS 2023 paper "Non-autoregressive Machine Translation with Probabilistic Context-free Grammar".☆12Jan 4, 2024Updated 2 years ago
- Implementation for "Rational Recurrences", Peng et al., EMNLP 2018.☆28Jun 21, 2022Updated 3 years ago
- NIILC QA data☆18Nov 20, 2015Updated 10 years ago
- A challenging aggregation benchmark for long-context models☆37Feb 22, 2026Updated last week
- sigma-MoE layer☆21Jan 5, 2024Updated 2 years ago
- A C++ library implementing fast language models estimation using the 1-Sort algorithm.☆17May 18, 2023Updated 2 years ago
- Official implementation of the ACL 2022 paper "Learning Non-Autoregressive Models from Search for Unsupervised Sentence Summarization"☆14Dec 26, 2022Updated 3 years ago
- ☆17Apr 28, 2022Updated 3 years ago
- Hierarchical Softmax Layer☆18Oct 7, 2015Updated 10 years ago
- Scripts for creating a Japanese-English parallel corpus and training NMT models☆18Nov 9, 2021Updated 4 years ago
- A Japanese dependency parser based on BERT☆23Oct 26, 2022Updated 3 years ago
- Triton Implementation of HyperAttention Algorithm☆48Dec 11, 2023Updated 2 years ago
- ☆20Oct 25, 2022Updated 3 years ago
- PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023☆20May 31, 2023Updated 2 years ago
- CUDA 12.2 HMM demos☆20Jul 26, 2024Updated last year
- Data and code related to the ICASSP submission "A comparison of methods for OOV-word recognition"☆17Nov 28, 2021Updated 4 years ago
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆60Jun 3, 2024Updated last year
- A Docker image for Lua Torch☆26Sep 12, 2017Updated 8 years ago
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆102Sep 30, 2024Updated last year
- ☆26Sep 15, 2022Updated 3 years ago
- python版日本語意味役割付与システム（ASA）☆22Nov 11, 2022Updated 3 years ago
- 首都大日本語 Twitter コーパス☆21Mar 14, 2016Updated 9 years ago
- Checkpointable dataset utilities for foundation model training☆32Jan 29, 2024Updated 2 years ago
- Code for the ALiBi method for transformer language models (ICLR 2022)☆552Oct 30, 2023Updated 2 years ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Apr 17, 2024Updated last year
- Codebase for PRISE: Learning Temporal Action Abstractions as a Sequence Compression Problem☆24Jul 11, 2024Updated last year
- CLI tool that lets you chat with your agent locally for faster feedback and debugging☆34Nov 21, 2024Updated last year
- Staged Training for Transformer Language Models☆33Mar 31, 2022Updated 3 years ago
- ☆24Dec 26, 2017Updated 8 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32May 25, 2024Updated last year
- Official Code Repository for the paper "Key-value memory in the brain"☆31Feb 25, 2025Updated last year
- FairSeq repo with Apollo optimizer☆114Dec 20, 2023Updated 2 years ago
- [EACL'21] Non-Autoregressive with Pretrained Language Model☆61Oct 10, 2022Updated 3 years ago
- Implementation of a deep recursive net over binary parse trees (code for NIPS2014 paper)☆28Feb 6, 2015Updated 11 years ago