Alternatives and similar repositories for kitoken:

Users that are interested in kitoken are comparing it to the libraries listed below

• lightonai / ducksearch
  Efficient BM25 with DuckDB 🦆
  ☆48Updated 4 months ago
• mixedbread-ai / binary-embeddings
  Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…
  ☆17Updated last year
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• kyutai-labs / moshi-webrtc
  Proof of concept for running moshi/hibiki using webrtc
  ☆18Updated 2 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆62Updated 11 months ago
• Dan-wanna-M / kbnf
  A high-performance constrained decoding engine based on context free grammar in Rust
  ☆50Updated 4 months ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆28Updated last year
• huggingface / ember
  ANE accelerated embedding models!
  ☆16Updated 4 months ago
• ashvardanian / usearch-binary
  Binary vector search example using Unum's USearch engine and pre-computed Wikipedia embeddings from Co:here and MixedBread
  ☆18Updated last year
• michaelfeil / candle-flash-attn-v3
  ☆11Updated 3 months ago
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆127Updated this week
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆54Updated 7 months ago
• microsoft / REBEL
  ☆34Updated 2 weeks ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆58Updated 3 weeks ago
• Narsil / bloomserver
  ☆39Updated 2 years ago
• BlackHC / llmtracer
  Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
  ☆14Updated 2 months ago
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆17Updated 3 weeks ago
• kyutai-labs / kaudio
  Rust crate for some audio utilities
  ☆23Updated 2 months ago
• RAIVNLab / AdANNS
  Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"
  ☆64Updated last year
• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆17Updated 2 years ago
• fbilhaut / gline-rs
  Inference engine for GLiNER models, in Rust
  ☆57Updated last month
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆26Updated last year
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆46Updated 3 weeks ago
• kyutai-labs / dactory
  ☆24Updated last week
• generall / hnsw-python
  hnsw implemented by python
  ☆20Updated 5 years ago
• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆22Updated 2 years ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆40Updated last week
• ChrisHayduk / QLoRA-for-MLM
  QLoRA for Masked Language Modeling
  ☆22Updated last year
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated last year
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 9 months ago