JulesBelveze / bert-squeeze
π οΈ Tools for Transformers compression using PyTorch Lightning β‘
β81Updated 3 months ago
Alternatives and similar repositories for bert-squeeze:
Users that are interested in bert-squeeze are comparing it to the libraries listed below
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.β93Updated 2 years ago
- β87Updated 2 years ago
- β42Updated last year
- PyTorch-IE: State-of-the-art Information Extraction in PyTorchβ77Updated this week
- Open source library for few shot NLPβ77Updated last year
- β74Updated 3 years ago
- A library to synthesize text datasets using Large Language Models (LLM)β151Updated 2 years ago
- Shared code for training sentence embeddings with Flax / JAXβ27Updated 3 years ago
- β21Updated 3 years ago
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scaleβ154Updated last year
- A Python library aimed at dissecting and augmenting NER training data.β58Updated last year
- β18Updated 2 years ago
- Augmenty is an augmentation library based on spaCy for augmenting texts.β151Updated 8 months ago
- Tutorial to pretrain & fine-tune a π€ Flax T5 model on a TPUv3-8 with GCPβ58Updated 2 years ago
- Execute arbitrary SQL queries on π€ Datasetsβ32Updated last year
- Using business-level retrieval system (BM25) with Python in just a few lines.β31Updated 2 years ago
- SQuARE: Software for question answering research.β74Updated 7 months ago
- Code for the paper: Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queriesβ19Updated 3 years ago
- Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.β126Updated 4 years ago
- Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.β102Updated 2 years ago
- β55Updated 2 years ago
- Few-shot Named Entity Recognitionβ123Updated 2 years ago
- β45Updated 2 years ago
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)β60Updated last year
- This repository contains the code for the paper 'PARM: Paragraph Aggregation Retrieval Model for Dense Document-to-Document Retrieval' puβ¦β40Updated 3 years ago
- Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP modelsβ¦β37Updated 2 years ago
- β67Updated 3 years ago
- Google's BigBird (Jax/Flax & PyTorch) @ π€Transformersβ48Updated last year
- No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrievalβ28Updated 2 years ago
- Multi-task modelling extensions for huggingface transformersβ20Updated last year