ai-forever / mgpt
Multilingual Generative Pretrained Model
☆203Updated 8 months ago
Alternatives and similar repositories for mgpt:
Users that are interested in mgpt are comparing it to the libraries listed below
- Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.☆125Updated 2 years ago
- ☆57Updated 11 months ago
- NEREL: A Russian Dataset with Nested Named Entities, Relations and Events☆26Updated last year
- Pipeline for easy fine-tuning of BERT architecture for sequence classification☆22Updated last year
- Russian paraphrasers. Generate paraphrases with mt5, gpt2, etc.☆53Updated last year
- A Russian data set for question answering over Wikidata☆47Updated 3 years ago
- Unofficial implementation of QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition.☆66Updated 2 years ago
- Models for automatic abstractive summarization☆172Updated 2 years ago
- Code and data of "Methods for Detoxification of Texts for the Russian Language" paper☆46Updated 4 months ago
- Russian Artificial Text Detection☆17Updated 2 years ago
- BSNLP 2021☆33Updated 2 months ago
- Russian Corpus of Linguistic Acceptability☆42Updated 3 months ago
- Dual Encoders for State-of-the-art Natural Language Processing.☆61Updated 2 years ago
- A small library with distillation, quantization and pruning pipelines☆26Updated 3 years ago
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale☆154Updated last year
- Reduce the size of pretrained Hugging Face models via vocabulary trimming.☆43Updated 2 years ago
- SAGE: Spelling correction, corruption and evaluation for multiple languages☆143Updated 3 weeks ago
- Shared BERT model for 4 languages of Bulgarian, Czech, Polish and Russian. Slavic NER model.☆73Updated 2 years ago
- Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.☆102Updated 2 years ago
- Probing suite for evaluation of Russian embedding and language models☆32Updated 3 months ago
- MOdel ResOurCe COnsumption. Evaluate Russian SuperGLUE models performance: inference speed, RAM usage. Reproducible scores using Docker☆21Updated 2 years ago
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…☆61Updated 3 months ago
- Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP☆58Updated 2 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆187Updated 3 years ago
- Code for AINL2018 paper Deep Convolutional Networks for Supervised Morpheme Segmentation of Russian Language☆19Updated 5 years ago
- ☆23Updated 2 months ago
- A sentence paraphraser based on dependency parsing and word embedding similarity.☆22Updated 3 years ago
- CLIP implementation for Russian language☆140Updated last year
- Russian SuperGLUE benchmark☆109Updated last year
- Tools for shrinking fastText models (in gensim format)☆176Updated 8 months ago