Koziev / LM-finetune
Код для файнтюна LM (rugpt, LLaMa, FRED T5) средствами transformers + deepspeed + LoRa
☆15Updated last year
Alternatives and similar repositories for LM-finetune:
Users that are interested in LM-finetune are comparing it to the libraries listed below
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…☆62Updated 4 months ago
- Библиотека для извлечения статистик из текстов на русском языке.☆116Updated 2 years ago
- RuLeanALBERT is a pretrained masked language model for the Russian language that uses a memory-efficient architecture.☆93Updated last year
- Russian SuperGLUE benchmark☆109Updated last year
- Compact high quality word embeddings for Russian language☆192Updated last year
- Бенчмарк сравнивает русские аналоги ChatGPT: Saiga, YandexGPT, Gigachat☆60Updated last year
- The tiniest sentence encoder for Russian language☆209Updated 6 months ago
- Effective LLM Alignment Toolkit☆115Updated this week
- ☆57Updated last year
- SAGE: Spelling correction, corruption and evaluation for multiple languages☆147Updated 2 months ago
- Telegram bot for different language models. Supports system prompts and images☆45Updated 2 months ago
- Deep Learning based NLP modeling for Russian language☆228Updated last year
- Библиотека для доступа к GigaChat☆78Updated 3 weeks ago
- Language modeling and instruction tuning for Russian☆466Updated 6 months ago
- Python text speller☆39Updated last month
- Сжатие и ускорение моделей машинного обучения☆18Updated last year
- Training a Russian DialoGPT model.☆24Updated 5 years ago
- Gazeta: Dataset for automatic summarization of Russian news / Газета: набор данных для автоматического реферирования на русском языке☆34Updated 3 years ago
- Мастер-класс по созданию диалогового чат-бота на основе Retrieval-Augmented Generation☆32Updated last year
- ☆15Updated last year
- Augmentex — a library for augmenting texts with errors☆61Updated 7 months ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆38Updated 2 months ago
- NLP model zoo for Russian☆45Updated 3 years ago
- Диалоговая система на базе FRED-T5☆36Updated last year
- Русскоязычный генеративный чатбот с профилем и фактами☆258Updated 2 years ago
- Russian text segmenter and tokenizer☆16Updated 3 years ago
- A series of Jupyter notebooks that walk you through the projects from beginner to jun☆8Updated 2 years ago
- Using transformers to generate Russian poetry☆35Updated last year
- Bunch of notebooks for pre-training custom Saiga-like LLM☆13Updated last year
- ML Course created for Bauman Moscow State Technical University☆60Updated 2 years ago