daac-tools / find-simdocView external linksLinks
Finding all pairs of similar documents time- and memory-efficiently
☆62Mar 13, 2025Updated 11 months ago
Alternatives and similar repositories for find-simdoc
Users that are interested in find-simdoc are comparing it to the libraries listed below
Sorting:
- Awesome List of Sources of Japanese Censored Words☆19Sep 11, 2022Updated 3 years ago
- This repository has implementations of data augmentation for NLP for Japanese.☆64Feb 16, 2023Updated 2 years ago
- 🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.☆21Jun 1, 2025Updated 8 months ago
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)☆20Mar 15, 2025Updated 10 months ago
- Yada is a yet another double-array trie library aiming for fast search and compact data representation.☆44Feb 25, 2024Updated last year
- YAST - Yet Another SPLADE or Sparse Trainer☆21Jun 16, 2025Updated 7 months ago
- ☆11Aug 26, 2021Updated 4 years ago
- An integrated Japanese analyzer based on foundation models☆138Feb 2, 2026Updated last week
- Funer is Rule based Named Entity Recognition tool.☆22Apr 21, 2022Updated 3 years ago
- The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.☆124Nov 13, 2025Updated 3 months ago
- AllenNLP integration for Shiba: Japanese CANINE model☆12Jun 26, 2021Updated 4 years ago
- The evaluation scripts of JMTEB (Japanese Massive Text Embedding Benchmark)☆84Jan 6, 2026Updated last month
- Utility scripts for preprocessing Wikipedia texts for NLP☆78Apr 9, 2024Updated last year
- Code for COLING 2020 Paper☆13Feb 3, 2026Updated last week
- 🦞 Rust library of natural language dictionaries using character-wise double-array tries.☆36Jan 13, 2025Updated last year
- Japanese tokenizer for Transformers☆79Dec 15, 2023Updated 2 years ago
- A tool for visualizing the internal structures of morphological analyzer Sudachi☆18Jun 9, 2022Updated 3 years ago
- 日本語テキストに対する wikification のためのソフトウェア☆17Mar 14, 2017Updated 8 years ago
- ☯️ AllenNLP training configurations for promising models on Named Entity Recognition. (BiLSTM-CRF, BiLSTM-CNN-CRF, BERT, BERT-CRF)☆15Nov 26, 2020Updated 5 years ago
- ☆29Apr 10, 2025Updated 10 months ago
- Pytorch implementation and pre-trained Japanese model for CANINE, the efficient character-level transformer.☆89Nov 3, 2023Updated 2 years ago
- 自然言語で書かれた時間情報表現を抽出/規格化するルールベースの解析器☆140Feb 27, 2025Updated 11 months ago
- Rust implementation of SIF and uSIF: Simple and fast sentence embedding☆19Jan 22, 2025Updated last year
- ☆19May 23, 2024Updated last year
- A soft and fast pattern matcher for billion-scale corpora.☆72Feb 26, 2025Updated 11 months ago
- 🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer☆251Feb 7, 2026Updated last week
- 🎤 vibrato: Viterbi-based accelerated tokenizer☆398Feb 7, 2026Updated last week
- Discovering Universal Geometry in Embeddings with ICA (Published in EMNLP 2023)☆20Jun 17, 2025Updated 7 months ago
- Course materials for a 3-day seminar "Machine Learning and NLP: Advances and Applications" at New College of Florida☆12Feb 10, 2022Updated 4 years ago
- 解析が難しい日本の住所のテストデータセット☆14Sep 25, 2023Updated 2 years ago
- ISUCON用代わりにsshしていろいろやってくれるツール☆11Nov 25, 2023Updated 2 years ago
- Includes a file with zstd compression in Rust☆13Feb 17, 2023Updated 2 years ago
- A language server implementation for pysen☆10Nov 14, 2021Updated 4 years ago
- Implementation for ACL 2024 paper "Meta-Task Prompting Elicits Embeddings from Large Language Models"☆12Jul 25, 2024Updated last year
- An implementation of "Subspace Representations for Soft Set Operations and Sentence Similarities" (NAACL 2024)☆10May 31, 2024Updated last year
- ☆10Sep 14, 2022Updated 3 years ago
- [WIP] Molizen is a typed actor framework for Go.☆41Apr 5, 2022Updated 3 years ago
- 4000+ annotated 顔文字 (kaomoji) in JSON (UTF-8 & ShiftJIS)ヽ(`Д´*)ノ☆26Jul 11, 2014Updated 11 years ago
- 情報検索100本ノック☆93Dec 3, 2025Updated 2 months ago