AlekseyKorshuk / optimum-transformers
Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.
☆126Updated 2 years ago
Related projects: ⓘ
- ☆58Updated 7 months ago
- BSNLP 2021☆32Updated 2 years ago
- A small library with distillation, quantization and pruning pipelines☆26Updated 3 years ago
- MMLU eval for RU/EN☆14Updated last year
- Pipeline for easy fine-tuning of BERT architecture for sequence classification☆22Updated last year
- Tools for shrinking fastText models (in gensim format)☆168Updated 4 months ago
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…☆57Updated this week
- MOdel ResOurCe COnsumption. Evaluate Russian SuperGLUE models performance: inference speed, RAM usage. Reproducible scores using Docker☆21Updated last year
- Distillation of BERT model with catalyst framework☆75Updated last year
- Train punctuation and capitalization models for different languages☆24Updated 2 years ago
- RuTransform: python framework for adversarial attacks and text data augmentation for Russian☆17Updated last year
- SAGE: Spelling correction, corruption and evaluation for multiple languages☆129Updated last month
- ☆18Updated last year
- Code and data of "Methods for Detoxification of Texts for the Russian Language" paper☆45Updated 3 weeks ago
- Russian paraphrasers. Generate paraphrases with mt5, gpt2, etc.☆52Updated last year
- Russian Corpus of Linguistic Acceptability☆40Updated last year
- Augmentex — a library for augmenting texts with errors☆48Updated 2 months ago
- Multilingual Generative Pretrained Model☆200Updated 4 months ago
- RuCLIP tiny (Russian Contrastive Language–Image Pretraining) is a neural network trained to work with different pairs (images, texts).☆32Updated 2 years ago
- Russian dialog datasets parsers and crawlers.☆15Updated 3 years ago
- A Russian data set for question answering over Wikidata☆46Updated 3 years ago
- Infrastructure for starting TG bot project. Postgres, Minio, Grafana, Alembic☆21Updated 2 years ago
- RuSimpleSentEval (RSSE) shared task repo☆21Updated 3 years ago
- REST API for sentence tokenization and embedding using Multilingual Universal Sentence Encoder.☆52Updated 3 years ago
- CLIP implementation for Russian language☆136Updated 10 months ago
- https://arxiv.org/abs/2201.06499☆28Updated 5 months ago
- Framework for processing and filtering datasets☆25Updated last month
- Gazeta: Dataset for automatic summarization of Russian news / Газета: набор данных для автоматического реферирования на русском языке☆30Updated 2 years ago
- Pytorch library for end-to-end transformer models training, inference and serving☆70Updated 2 years ago
- Russian SuperGLUE benchmark☆106Updated last year