Alternatives and similar repositories for kitoken

Users that are interested in kitoken are comparing it to the libraries listed below

• beowolx / rensa
  High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…
  ☆223Updated 2 weeks ago
• fbilhaut / gline-rs
  Inference engine for GLiNER models, in Rust
  ☆81Updated last month
• serega / gaoya
  Locality Sensitive Hashing
  ☆77Updated 2 years ago
• allenai / duplodocus
  Tooling for exact and MinHash deduplication of large-scale text datasets
  ☆44Updated this week
• zhao-lang / redis_hnsw
  HSNW module for Redis
  ☆59Updated 5 years ago
• kyutai-labs / moshi-webrtc
  Proof of concept for running moshi/hibiki using webrtc
  ☆19Updated 9 months ago
• Dan-wanna-M / kbnf
  A high-performance constrained decoding engine based on context free grammar in Rust
  ☆56Updated 6 months ago
• RAIVNLab / AdANNS
  Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"
  ☆65Updated 2 years ago
• Narsil / bloomserver
  ☆39Updated 3 years ago
• yaman / fashion-clip-rs
  A complete(grpc service and lib) Rust inference with multilingual embedding support. This version leverages the power of Rust for both GR…
  ☆39Updated last year
• bminixhofer / tractjs
  Run ONNX and TensorFlow inference in the browser.
  ☆75Updated 2 years ago
• Snowflake-Labs / arctic-embed
  ☆81Updated last month
• ashvardanian / JaccardIndex
  Optimizing bit-level Jaccard Index and Population Counts for large-scale quantized Vector Search via Harley-Seal CSA and Lookup Tables
  ☆21Updated 7 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆70Updated 7 months ago
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated 5 months ago
• kyutai-labs / kaudio
  Rust crate for some audio utilities
  ☆25Updated 9 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆93Updated 3 months ago
• haixuanTao / bert-onnx-rs-server
  A Demo server serving Bert through ONNX with GPU written in Rust with <3
  ☆41Updated 4 years ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆31Updated last year
• generall / hnsw-python
  hnsw implemented by python
  ☆21Updated 6 years ago
• MinishLab / model2vec-rs
  Official Rust Implementation of Model2Vec
  ☆143Updated 2 months ago
• iantbutler01 / ditty
  A library for simplifying training with multi gpu setups in the HuggingFace / PyTorch ecosystem.
  ☆16Updated last week
• infrawhispers / anansi
  open source tooling for AI search and understanding
  ☆51Updated 2 years ago
• raphaelsty / neural-tree
  Tree-based indexes for neural-search
  ☆31Updated last year
• mithril-security / tokenizers-wasm
  wasm bindings for huggingface tokenizers library
  ☆34Updated 3 years ago
• michaelfeil / candle-flash-attn-v3
  ☆13Updated last week
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Updated 2 years ago
• AnswerDotAI / fastkmeans
  ☆89Updated 5 months ago
• pisa-engine / BMP
  Faster Learned Sparse Retrieval with Block-Max Pruning. ACM SIGIR 2024.
  ☆32Updated 2 weeks ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆26Updated last year