JulesBelveze / bert-squeezeLinks
π οΈ Tools for Transformers compression using PyTorch Lightning β‘
β83Updated 7 months ago
Alternatives and similar repositories for bert-squeeze
Users that are interested in bert-squeeze are comparing it to the libraries listed below
Sorting:
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.β93Updated 2 years ago
- β87Updated 3 years ago
- PyTorch-IE: State-of-the-art Information Extraction in PyTorchβ77Updated 3 weeks ago
- A library to synthesize text datasets using Large Language Models (LLM)β152Updated 2 years ago
- Tutorial to pretrain & fine-tune a π€ Flax T5 model on a TPUv3-8 with GCPβ58Updated 2 years ago
- Few-shot Named Entity Recognitionβ123Updated 3 years ago
- A Python library aimed at dissecting and augmenting NER training data.β58Updated 2 years ago
- Helper scripts and notes that were used while porting various nlp modelsβ46Updated 3 years ago
- Open source library for few shot NLPβ78Updated 2 years ago
- β28Updated 2 years ago
- Shared code for training sentence embeddings with Flax / JAXβ27Updated 3 years ago
- Bi-encoder entity linking architectureβ46Updated 9 months ago
- β43Updated 2 years ago
- Embedding Recycling for Language modelsβ38Updated last year
- Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.β103Updated 3 years ago
- β21Updated 3 years ago
- Using business-level retrieval system (BM25) with Python in just a few lines.β31Updated 2 years ago
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)β61Updated 2 years ago
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scaleβ155Updated last year
- Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.β127Updated 4 years ago
- β54Updated 2 years ago
- Execute arbitrary SQL queries on π€ Datasetsβ32Updated last year
- No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrievalβ29Updated 2 years ago
- β16Updated 2 years ago
- This repository contains the code for the paper 'PARM: Paragraph Aggregation Retrieval Model for Dense Document-to-Document Retrieval' puβ¦β40Updated 3 years ago
- Dense hybrid representations for text retrievalβ63Updated 2 years ago
- β19Updated 2 years ago
- Multi-task modelling extensions for huggingface transformersβ20Updated 2 years ago
- β76Updated 3 years ago
- Google's BigBird (Jax/Flax & PyTorch) @ π€Transformersβ49Updated 2 years ago