Tools and scripts for experimenting with Transformers: Bert, T5...
☆61Jan 6, 2024Updated 2 years ago
Alternatives and similar repositories for t5-experiments
Users that are interested in t5-experiments are comparing it to the libraries listed below
Sorting:
- [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluation☆62Mar 12, 2026Updated last week
- ☆10Jan 16, 2024Updated 2 years ago
- Experiments on the impact of depth in transformers and SSMs.☆41Oct 23, 2025Updated 4 months ago
- Chatsky is a free and open-source software stack for creating chatbots, released under the terms of Apache License 2.0.☆138Jul 8, 2025Updated 8 months ago
- MMLU eval for RU/EN☆15Jul 31, 2023Updated 2 years ago
- ☆15Nov 20, 2023Updated 2 years ago
- Unofficial implementation of the Ask-LLM paper 'How to Train Data-Efficient LLMs', arXiv:2402.09668.☆12Jun 19, 2024Updated last year
- code for paper "Discerning and Resolving Knowledge Conflicts through Adaptive Decoding with Contextual Information-Entropy Constraint"☆12Sep 29, 2024Updated last year
- ☆18Mar 20, 2019Updated 7 years ago
- Recurrent Memory Transformer☆156Aug 14, 2023Updated 2 years ago
- The official repository for Efficient Long-Text Understanding Using Short-Text Models (Ivgi et al., 2022) paper☆70May 14, 2023Updated 2 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 2 years ago
- an implementation of paper"Retentive Network: A Successor to Transformer for Large Language Models" https://arxiv.org/pdf/2307.08621.pdf☆11Jul 25, 2023Updated 2 years ago
- [COLING'22] Code for our paper: "COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarization"☆22Oct 21, 2022Updated 3 years ago
- Repo for the paper "Exploiting redundancy in large materials datasets for efficient machine learning with less data"☆11Sep 23, 2024Updated last year
- ☆12Feb 14, 2024Updated 2 years ago
- Open Source framework for developing Dialog Agents☆20Mar 26, 2018Updated 7 years ago
- Probing suite for evaluation of Russian embedding and language models☆33Oct 1, 2024Updated last year
- 32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.☆50Jun 16, 2023Updated 2 years ago
- Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …☆118Mar 16, 2024Updated 2 years ago
- ☆13Dec 7, 2022Updated 3 years ago
- [ACL‘20] Highway Transformer: A Gated Transformer.☆33Dec 5, 2021Updated 4 years ago
- DeepPavlov Agent☆68Apr 29, 2024Updated last year
- Official code for Long Expressive Memory (ICLR 2022, Spotlight)☆71Mar 11, 2022Updated 4 years ago
- ☆13Feb 20, 2020Updated 6 years ago
- Official code for UnICORNN (ICML 2021)☆28Oct 1, 2021Updated 4 years ago
- ☆58Jul 9, 2024Updated last year
- ☆24Aug 15, 2017Updated 8 years ago
- Research work aimed at addressing the problem of modeling infinite-length context☆48Dec 18, 2025Updated 3 months ago
- A Parallel Russian-Simple Russian Dataset☆15Mar 30, 2023Updated 2 years ago
- TextoKit - is a set of components for Natural Language Processing based on Apache UIMA platform.☆16Jul 6, 2016Updated 9 years ago
- Source code of our paper "Focus on the Target’s Vocabulary: Masked Label Smoothing for Machine Translation" @ ACL 2022☆13Apr 13, 2022Updated 3 years ago
- Official code for Coupled Oscillatory RNN (ICLR 2021, Oral)☆53Aug 26, 2021Updated 4 years ago
- VisBERT: Demo web app for "How Does BERT Answer Questions?"☆11Jul 22, 2023Updated 2 years ago
- GENA-LM is a transformer masked language model trained on human DNA sequence.☆221Updated this week
- ☆22Aug 31, 2021Updated 4 years ago
- Calculate similarity with embedding☆11Jan 22, 2022Updated 4 years ago
- Annotated sequence data☆11Feb 2, 2025Updated last year
- Stacking Machine Learning Models. Tunning; feature engineering, scaling, models combinations and parameters.☆11Oct 4, 2020Updated 5 years ago