Alternatives and similar repositories for kitoken

Users that are interested in kitoken are comparing it to the libraries listed below

• fbilhaut / gline-rs
  Inference engine for GLiNER models, in Rust
  ☆71Updated 3 months ago
• Dan-wanna-M / kbnf
  A high-performance constrained decoding engine based on context free grammar in Rust
  ☆55Updated 4 months ago
• serega / gaoya
  Locality Sensitive Hashing
  ☆74Updated 2 years ago
• beowolx / rensa
  High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…
  ☆204Updated 2 months ago
• oxidized-transformers / oxidized-transformers
  Modular Rust transformer/LLM library using Candle
  ☆37Updated last year
• pisa-engine / kentro
  High-Performance K-Means Clustering Library
  ☆30Updated 2 months ago
• kyutai-labs / moshi-webrtc
  Proof of concept for running moshi/hibiki using webrtc
  ☆20Updated 7 months ago
• yaman / fashion-clip-rs
  A complete(grpc service and lib) Rust inference with multilingual embedding support. This version leverages the power of Rust for both GR…
  ☆39Updated last year
• pisa-engine / BMP
  Faster Learned Sparse Retrieval with Block-Max Pruning. ACM SIGIR 2024.
  ☆31Updated last week
• haixuanTao / bert-onnx-rs-server
  A Demo server serving Bert through ONNX with GPU written in Rust with <3
  ☆41Updated 4 years ago
• kyutai-labs / kaudio
  Rust crate for some audio utilities
  ☆26Updated 6 months ago
• zhao-lang / redis_hnsw
  HSNW module for Redis
  ☆57Updated 5 years ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆65Updated 4 months ago
• ashvardanian / jaccard-index
  Optimizing bit-level Jaccard Index and Population Counts for large-scale quantized Vector Search via Harley-Seal CSA and Lookup Tables
  ☆21Updated 4 months ago
• lightonai / ducksearch
  Efficient BM25 with DuckDB 🦆
  ☆55Updated 9 months ago
• michaelfeil / candle-flash-attn-v3
  ☆12Updated 8 months ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆26Updated last year
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆85Updated 3 weeks ago
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆55Updated 3 months ago
• jermp / tongrams_estimation
  A C++ library implementing fast language models estimation using the 1-Sort algorithm.
  ☆17Updated 2 years ago
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 11 months ago
• mithril-security / tokenizers-wasm
  wasm bindings for huggingface tokenizers library
  ☆34Updated 3 years ago
• chenwanqq / candle-llava
  implement llava using candle
  ☆15Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• Snowflake-Labs / arctic-embed
  ☆77Updated 9 months ago
• huggingface / candle-cublaslt
  ☆12Updated last year
• Narsil / bloomserver
  ☆39Updated 3 years ago
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Updated 2 years ago
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆79Updated last year
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆65Updated last week