nouu-me / document_vector_search_benchmarkLinks
Benchmark for Japanese document embedding & vector search
☆29Updated last year
Alternatives and similar repositories for document_vector_search_benchmark
Users that are interested in document_vector_search_benchmark are comparing it to the libraries listed below
Sorting:
- ☆27Updated last year
- ☆51Updated 2 years ago
- The evaluation scripts of JMTEB (Japanese Massive Text Embedding Benchmark)☆78Updated last month
- ☆11Updated last year
- ☆24Updated 2 years ago
- 【2024年版】BERTによるテキスト分類☆30Updated last year
- YAST - Yet Another SPLADE or Sparse Trainer☆21Updated 6 months ago
- This repository has implementations of data augmentation for NLP for Japanese.☆64Updated 2 years ago
- Utility scripts for preprocessing Wikipedia texts for NLP☆78Updated last year
- JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset, LREC-COLING 2024☆25Updated last year
- Finding all pairs of similar documents time- and memory-efficiently☆62Updated 9 months ago
- ☆20Updated 4 months ago
- Japanese LLaMa experiment☆54Updated 2 months ago
- JQaRA: Japanese Question Answering with Retrieval Augmentation - 検索拡張(RAG)評価のための日本語Q&Aデータセット☆40Updated 3 months ago
- A tool for comparing tokenizers☆120Updated last month
- A soft and fast pattern matcher for billion-scale corpora.☆68Updated 9 months ago
- Japanese synonym library☆55Updated 3 years ago
- The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.☆124Updated last month
- ☆44Updated 3 months ago
- ☆19Updated last year
- ✂️ OpenProvence: Open-Source, Efficient, and Robust Context Pruning for Retrieval-Augmented Generation☆33Updated last month
- ☆88Updated 2 years ago
- Flexible evaluation tool for language models☆55Updated last week
- DistilBERT model pre-trained on 131 GB of Japanese web text. The teacher model is BERT-base that built in-house at LINE.☆46Updated 2 years ago
- Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)☆77Updated 2 years ago
- Convert xlsx/docx/pptx files to PDFs☆19Updated 4 months ago
- FAST is an annotation tool that focuses on mobile devices. https://aclanthology.org/2021.emnlp-demo.41/☆53Updated 4 years ago
- This is the repository for TRF (text readability features) publication.☆37Updated 6 years ago
- ☆18Updated last year
- 日本語マルチタスク言語理解ベンチマーク Japanese Massive Multitask Language Understanding Benchmark☆38Updated 2 months ago