AlekseyKorshuk / optimum-transformersLinks
Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.
☆126Updated 3 years ago
Alternatives and similar repositories for optimum-transformers
Users that are interested in optimum-transformers are comparing it to the libraries listed below
Sorting:
- A small library with distillation, quantization and pruning pipelines☆26Updated 4 years ago
- RuCLIP tiny (Russian Contrastive Language–Image Pretraining) is a neural network trained to work with different pairs (images, texts).☆35Updated 3 years ago
- REST API for sentence tokenization and embedding using Multilingual Universal Sentence Encoder.☆51Updated 4 years ago
- Pipeline for easy fine-tuning of BERT architecture for sequence classification☆23Updated 2 years ago
- Multilingual Generative Pretrained Model☆207Updated last year
- Tools for shrinking fastText models (in gensim format)☆178Updated last year
- ☆57Updated last year
- BSNLP 2021☆33Updated 11 months ago
- ☆20Updated 2 years ago
- Distillation of BERT model with catalyst framework☆78Updated 2 years ago
- 🛠️ Tools for Transformers compression using PyTorch Lightning ⚡☆85Updated 3 weeks ago
- CLIP implementation for Russian language☆146Updated last year
- Pytorch library for end-to-end transformer models training, inference and serving☆70Updated 6 months ago
- MMLU eval for RU/EN☆15Updated 2 years ago
- Infrastructure for starting TG bot project. Postgres, Minio, Grafana, Alembic☆22Updated 3 years ago
- A library to synthesize text datasets using Large Language Models (LLM)☆151Updated 2 years ago
- MOdel ResOurCe COnsumption. Evaluate Russian SuperGLUE models performance: inference speed, RAM usage. Reproducible scores using Docker☆23Updated 3 years ago
- Comprehensive NLP Evaluation System☆187Updated last year
- Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.☆127Updated 4 years ago
- Single-line inference of SOTA deep learning models☆29Updated 2 years ago
- SAGE: Spelling correction, corruption and evaluation for multiple languages☆160Updated 10 months ago
- Russian paraphrasers. Generate paraphrases with mt5, gpt2, etc.☆54Updated 2 years ago
- Code and data of "Methods for Detoxification of Texts for the Russian Language" paper☆49Updated 6 months ago
- Train punctuation and capitalization models for different languages☆25Updated 3 years ago
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale☆156Updated last year
- A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models☆31Updated 4 years ago
- Question answering on russian with XLMRobertaLarge as a service☆21Updated 3 years ago
- ☆33Updated 6 years ago
- Code for BERT classifier finetuning for multiclass text classification☆71Updated 5 months ago
- Probing suite for evaluation of Russian embedding and language models☆33Updated last year