Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers
☆49Mar 20, 2023Updated 3 years ago
Alternatives and similar repositories for bigbird
Users that are interested in bigbird are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repositary hosts my experiments for the project, I did with OffNote Labs.☆10Apr 12, 2021Updated 5 years ago
- Transformers for Longer Sequences☆632Sep 1, 2022Updated 4 years ago
- Minimal implementation of Denoised Smoothing (https://arxiv.org/abs/2003.01908) in TensorFlow.☆20Aug 4, 2021Updated 5 years ago
- Chu-Liu-Edmonds maximum spanning algorithm from TurboParser for use within Python☆11Mar 9, 2024Updated 2 years ago
- ☆18Mar 18, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Finetune multiple pre-trained Transformer-based models to solve Vietnamese Fake News Detection problem (ReINTEL) in VLSP2020 shared task☆18Dec 16, 2020Updated 5 years ago
- GC4LM: A Colossal (Biased) language model for German☆13May 2, 2021Updated 5 years ago
- ☆13May 30, 2022Updated 4 years ago
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy mod…☆15Apr 21, 2023Updated 3 years ago
- This repository hosts code for converting the original MLP Mixer models (JAX) to TensorFlow.☆15Sep 29, 2021Updated 5 years ago
- Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP☆59Jul 28, 2022Updated 4 years ago
- A text truncation method, useful for instance in long text classification☆22Jun 22, 2022Updated 4 years ago
- This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…☆27Oct 20, 2022Updated 4 years ago
- GSoC'2021 | TensorFlow implementation of Wav2Vec2☆90Jan 11, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Simple script for hunting trending papers everyday.☆11Dec 23, 2020Updated 5 years ago
- Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillation☆117Jul 11, 2021Updated 5 years ago
- ☆12Mar 4, 2025Updated last year
- Obtain emails using the LinkedIn Graph API☆11Oct 1, 2025Updated last year
- [ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen…☆28Aug 29, 2023Updated 3 years ago
- Text Classification Dataset for Turkish Language☆10Nov 16, 2021Updated 4 years ago
- Coding utilities for quantitative legal studies☆14Dec 7, 2025Updated 11 months ago
- A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models☆30Apr 21, 2021Updated 5 years ago
- Implementations of some self-supervised methods for pre-training vision models☆18Jan 29, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Enhancing Relation Extraction using Syntactic Indicators and Sentential Contexts☆12Aug 27, 2019Updated 7 years ago
- import your conversation history into AI 🫚☆17Sep 7, 2026Updated 2 months ago
- A parameter-efficient compression model architecture for a variety of NLP tasks at BERT level performance at a fraction of the computatio…☆10Jan 25, 2026Updated 9 months ago
- A simple, line-oriented tabular data format☆10Jan 20, 2018Updated 8 years ago
- ☆13Mar 27, 2020Updated 6 years ago
- ☆11Mar 7, 2024Updated 2 years ago
- Text summarization with python and transformer☆13Jun 17, 2023Updated 3 years ago
- 📄 Evidence Retrieval and Claim Verification for the FEVER shared task using Transformer Networks☆12Feb 21, 2020Updated 6 years ago
- 100% MFU or bust.☆11Jan 12, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Machine learning to text-mine coronavirus research for CoronaCentral.ai☆12Jan 10, 2024Updated 2 years ago
- ☆13Sep 13, 2023Updated 3 years ago
- Neural question generation using transformers☆1,138Apr 5, 2024Updated 2 years ago
- A baseline system for ContractNLI (https://stanfordnlp.github.io/contract-nli/)☆38Mar 10, 2023Updated 3 years ago
- MXFP4-compatible 4-bit floating point types and block formats for Rust.☆12Mar 4, 2026Updated 8 months ago
- several algorithms for converting dependency structures into constituency structures.☆10Feb 7, 2022Updated 4 years ago
- Comparative study and experimentation on standard vs mHC vs attention residual (full and block)☆13Mar 17, 2026Updated 7 months ago