Finding all pairs of similar documents time- and memory-efficiently
☆62Mar 13, 2025Updated last year
Alternatives and similar repositories for find-simdoc
Users that are interested in find-simdoc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)☆20Mar 15, 2025Updated last year
- This repository has implementations of data augmentation for NLP for Japanese.☆64Feb 16, 2023Updated 3 years ago
- 🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.☆21Jun 1, 2025Updated 9 months ago
- Awesome List of Sources of Japanese Censored Words☆19Sep 11, 2022Updated 3 years ago
- YAST - Yet Another SPLADE or Sparse Trainer☆21Jun 16, 2025Updated 9 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 🦞 Rust library of natural language dictionaries using character-wise double-array tries.☆37Jan 13, 2025Updated last year
- Japanese synonym library☆55Feb 7, 2022Updated 4 years ago
- ☆29Apr 10, 2025Updated 11 months ago
- An integrated Japanese analyzer based on foundation models☆139Mar 2, 2026Updated 3 weeks ago
- Funer is Rule based Named Entity Recognition tool.☆22Apr 21, 2022Updated 3 years ago
- Includes a file with zstd compression in Rust☆13Feb 17, 2023Updated 3 years ago
- Utility scripts for preprocessing Wikipedia texts for NLP☆78Apr 9, 2024Updated last year
- 日本語テキストに対する wikification のためのソフトウェア☆17Mar 14, 2017Updated 9 years ago
- ☆11Aug 26, 2021Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A tool for visualizing the internal structures of morphological analyzer Sudachi☆18Jun 9, 2022Updated 3 years ago
- The evaluation scripts of JMTEB (Japanese Massive Text Embedding Benchmark)☆87Mar 16, 2026Updated last week
- The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.☆124Nov 13, 2025Updated 4 months ago
- Code for COLING 2020 Paper☆13Feb 3, 2026Updated last month
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.☆245Jan 26, 2026Updated 2 months ago
- Pytorch implementation and pre-trained Japanese model for CANINE, the efficient character-level transformer.☆89Nov 3, 2023Updated 2 years ago
- 解析が難しい日本の住所のテストデータセット☆14Sep 25, 2023Updated 2 years ago
- Course materials for a 3-day seminar "Machine Learning and NLP: Advances and Applications" at New College of Florida☆12Feb 10, 2022Updated 4 years ago
- Japanese tokenizer for Transformers☆79Dec 15, 2023Updated 2 years ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- AllenNLP integration for Shiba: Japanese CANINE model☆12Jun 26, 2021Updated 4 years ago
- 🌳 A compressed rank/select dictionary exploiting approximate linearity and repetitiveness.☆15Jun 28, 2022Updated 3 years ago
- Rust binding of primitiv☆20Jun 3, 2018Updated 7 years ago
- Notionに毎日新しいarXiv論文のアブストラクト日本語訳 + αを表示するスクリプト☆13Jan 22, 2023Updated 3 years ago
- 自然言語で書かれた時間情報表現を抽出/規格化するルールベースの解析器☆140Feb 27, 2025Updated last year
- Repository for JSICK☆45May 31, 2023Updated 2 years ago
- Kaggleのshopeeコンペのリポジトリ☆11Jun 7, 2021Updated 4 years ago
- ☆11Apr 2, 2017Updated 8 years ago
- ☯️ AllenNLP training configurations for promising models on Named Entity Recognition. (BiLSTM-CRF, BiLSTM-CNN-CRF, BERT, BERT-CRF)☆15Nov 26, 2020Updated 5 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A soft and fast pattern matcher for billion-scale corpora.☆75Feb 26, 2025Updated last year
- Yosina is a transliteration library deals with the letters and symbols used in Japanese writing.☆23Mar 19, 2026Updated last week
- 🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer☆254Feb 7, 2026Updated last month
- ☆10Sep 14, 2022Updated 3 years ago
- An implementation of "Subspace Representations for Soft Set Operations and Sentence Similarities" (NAACL 2024)☆10May 31, 2024Updated last year
- All my dotfile are belong to us. BUT MY CREDENTIALS ARE IN ANOTHER CASTLE.☆20Updated this week
- 4000+ annotated 顔文字 (kaomoji) in JSON (UTF-8 & ShiftJIS)ヽ(`Д´*)ﾉ☆26Jul 11, 2014Updated 11 years ago