huggingface / tune
β86Updated 2 years ago
Related projects β
Alternatives and complementary repositories for tune
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.β92Updated last year
- π οΈ Tools for Transformers compression using PyTorch Lightning β‘β79Updated last week
- β73Updated 3 years ago
- Shared code for training sentence embeddings with Flax / JAXβ27Updated 3 years ago
- Viewer for the π€ datasets library.β83Updated 3 years ago
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scaleβ153Updated 11 months ago
- Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.β101Updated 2 years ago
- Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.β126Updated 3 years ago
- Helper scripts and notes that were used while porting various nlp modelsβ44Updated 2 years ago
- On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselinesβ132Updated last year
- β21Updated 3 years ago
- State of the art Semantic Sentence Embeddingsβ98Updated 2 years ago
- This repository contains the code for the paper 'PARM: Paragraph Aggregation Retrieval Model for Dense Document-to-Document Retrieval' puβ¦β40Updated 2 years ago
- Generate BERT vocabularies and pretraining examples from Wikipediasβ18Updated 4 years ago
- This repository contains example code to build models on TPUsβ30Updated last year
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.β145Updated 3 years ago
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)β60Updated last year
- Tutorial to pretrain & fine-tune a π€ Flax T5 model on a TPUv3-8 with GCPβ58Updated 2 years ago
- LM Pretraining with PyTorch/TPUβ132Updated 5 years ago
- An extension package of π€ Datasets that provides support for executing arbitrary SQL queries on HF datasetsβ31Updated 9 months ago
- As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)β46Updated 3 years ago
- β76Updated 11 months ago
- Google's BigBird (Jax/Flax & PyTorch) @ π€Transformersβ47Updated last year
- Tools for managing datasets for governance and training.β78Updated 3 weeks ago
- A π€-style implementation of BERT using lambda layers instead of self-attentionβ70Updated 4 years ago
- A diff tool for language modelsβ42Updated 10 months ago
- A library to synthesize text datasets using Large Language Models (LLM)β151Updated last year
- β47Updated 4 years ago
- β18Updated 2 years ago