tsmatz / huggingface-finetune-japaneseLinks
Examples to finetune encoder-only and encoder-decoder transformers for Japanese language in Hugging Face (Oct 2022)
☆16Updated last year
Alternatives and similar repositories for huggingface-finetune-japanese
Users that are interested in huggingface-finetune-japanese are comparing it to the libraries listed below
Sorting:
- A series of notebooks demonstrating how to build simple NLP web apps with Gradio and Hugging Face transformers☆45Updated 3 years ago
- FRAKE: Fusional Real-time Automatic Keyword Extraction☆21Updated 2 years ago
- This repository contains the relevant materials for the tutorial "Legal IR and NLP: the History, Challenges, and State-of-the-Art", held …☆41Updated 2 years ago
- Annotation meets Large Language Models (ChatGPT, GPT-3 and alike).☆57Updated 2 years ago
- A Streamlit app running GPT-2 language model for text classification, built with Pytorch, Transformers and AWS SageMaker.☆39Updated 3 years ago
- Retrieval augmented generation demos with open-source DeepSeek, Llama, Qwen, Mistral, Gemma☆42Updated last week
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆88Updated last year
- MAFAND-MT☆57Updated last year
- A collection of preprocessed datasets and pretrained models for generating paraphrases.☆29Updated 4 years ago
- OpenNyAI is a mission aimed at developing open source software and datasets to catalyze the creation of AI-powered solutions to improve a…☆77Updated last year
- ☆13Updated 3 years ago
- Logical structure analysis for visually structured documents☆91Updated 2 years ago
- Abstractive and Extractive Text summarization using Transformers.☆84Updated 2 years ago
- Financial Domain Question Answering with pre-trained BERT Language Model☆127Updated last week
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated last year
- Easy to use and understand multiple-choice question generation algorithm using T5 Transformers.☆135Updated 3 years ago
- Web App Capable of Predicting Next Word Using BERT☆14Updated 2 years ago
- Paraphrasing for academic texts☆14Updated 2 years ago
- MobileBERT and DistilBERT for extractive summarization☆90Updated 2 years ago
- Evaluation of bm42 sparse indexing algorithm☆68Updated last year
- Aligned, Review-Informed Edits of Scientific Papers☆53Updated 2 years ago
- Efficient few-shot learning with cross-encoders.☆54Updated last year
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆10Updated last year
- A TextTiling-based algorithm for text segmentation (aka topic segmentation) that uses neural sentence encoders, as well as extractive sum…☆47Updated 2 years ago
- Source codes for the paper "Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints"☆27Updated 2 years ago
- Instruct LLMs for flat and nested NER. Fine-tuning Llama and Mistral models for instruction named entity recognition. (Instruction NER)☆84Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆77Updated 9 months ago
- 💭 Fine-tune a Covid-19 Doctor-like chatbot with GPT2☆51Updated 4 years ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆65Updated last year
- Using short models to classify long texts☆21Updated 2 years ago