Tools and scripts for experimenting with Transformers: Bert, T5...
☆61Jan 6, 2024Updated 2 years ago
Alternatives and similar repositories for t5-experiments
Users that are interested in t5-experiments are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluation☆66Mar 12, 2026Updated 3 months ago
- ☆10Jan 16, 2024Updated 2 years ago
- Experiments on the impact of depth in transformers and SSMs.☆41Oct 23, 2025Updated 8 months ago
- MMLU eval for RU/EN☆16Jul 31, 2023Updated 2 years ago
- ☆15Nov 20, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- code for paper "Discerning and Resolving Knowledge Conflicts through Adaptive Decoding with Contextual Information-Entropy Constraint"☆11Sep 29, 2024Updated last year
- ☆18Mar 20, 2019Updated 7 years ago
- The official repository for Efficient Long-Text Understanding Using Short-Text Models (Ivgi et al., 2022) paper☆70May 14, 2023Updated 3 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 2 years ago
- an implementation of paper"Retentive Network: A Successor to Transformer for Large Language Models" https://arxiv.org/pdf/2307.08621.pdf☆11Jul 25, 2023Updated 2 years ago
- [COLING'22] Code for our paper: "COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarization"☆22Oct 21, 2022Updated 3 years ago
- Code for AINL2018 paper Deep Convolutional Networks for Supervised Morpheme Segmentation of Russian Language☆25Aug 23, 2019Updated 6 years ago
- ☆13Jun 25, 2026Updated last week
- Open Source framework for developing Dialog Agents☆20Mar 26, 2018Updated 8 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Probing suite for evaluation of Russian embedding and language models☆32Oct 1, 2024Updated last year
- 32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.☆50Jun 16, 2023Updated 3 years ago
- Russian Text Expansion based on ruGPT3Large☆23May 1, 2022Updated 4 years ago
- [ACL‘20] Highway Transformer: A Gated Transformer.☆33Dec 5, 2021Updated 4 years ago
- Official code for Long Expressive Memory (ICLR 2022, Spotlight)☆70Mar 11, 2022Updated 4 years ago
- DeepPavlov Agent☆68Apr 29, 2024Updated 2 years ago
- ☆13Feb 20, 2020Updated 6 years ago
- Official code for UnICORNN (ICML 2021)☆27Oct 1, 2021Updated 4 years ago
- ☆30Dec 25, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Research work aimed at addressing the problem of modeling infinite-length context☆49Dec 18, 2025Updated 6 months ago
- Source code of our paper "Focus on the Target’s Vocabulary: Masked Label Smoothing for Machine Translation" @ ACL 2022☆13Apr 13, 2022Updated 4 years ago
- Official code for Coupled Oscillatory RNN (ICLR 2021, Oral)☆53Aug 26, 2021Updated 4 years ago
- ☆61Jul 9, 2024Updated last year
- GENA-LM is a transformer masked language model trained on human DNA sequence.☆228Jun 25, 2026Updated last week
- A Parallel Russian-Simple Russian Dataset☆18Mar 30, 2023Updated 3 years ago
- [NeurIPS 2025] Beyond Masked and Unmasked: Discrete Diffusion Models via Partial Masking☆31Jun 15, 2026Updated 2 weeks ago
- Project template for STAT-4830☆19Jun 23, 2026Updated last week
- A lexicon compiler for non-suffixational morphologies☆14Jan 29, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- NEREL: A Russian Dataset with Nested Named Entities, Relations and Events☆38Nov 1, 2023Updated 2 years ago
- ☆10Mar 19, 2018Updated 8 years ago
- ☆29Jul 9, 2024Updated last year
- Pipeline for generating reference and perturbed sequences for input into predictive models.☆12Nov 15, 2024Updated last year
- Library to extract embeddings for DNA sequences using BioFM genomics foundation model☆21Aug 13, 2025Updated 10 months ago
- LAReQA is a challenging benchmark for evaluating language agnostic answer retrieval from a multilingual candidate pool. This repository c…☆14May 19, 2020Updated 6 years ago
- Structural Variants ANnotator (SVAN)☆17Jun 15, 2026Updated 2 weeks ago