Alternatives and similar repositories for smaz-py3

Users that are interested in smaz-py3 are comparing it to the libraries listed below

• KorAP / Tokenizer-Evaluation
  Benchmark scripts for comparing different tokenizers and sentence segmenters of German
  ☆12Updated 2 years ago
• karlb / sqlite-spellfix
  Loadable spellfix1 extension for sqlite as python package
  ☆26Updated last year
• basnijholt / opennb
  Open Jupyter notebooks from GitHub repositories or URLs directly in Jupyter.
  ☆32Updated 6 months ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆26Updated 10 months ago
• kyutai-labs / dactory
  ☆41Updated 3 months ago
• gerrymanoim / libpy_simdjson
  Python bindings for simdjson using libpy
  ☆67Updated 2 years ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆64Updated 2 months ago
• cyrilou242 / ftcc
  Fast Text Classification with Compressors dictionary
  ☆150Updated last year
• openzim / python-libzim
  Libzim binding for Python: read/write ZIM files in Python
  ☆92Updated 3 months ago
• srush / drop7
  ☆18Updated last year
• brohrer / sqlogging
  Sqlite3-based logging for Python
  ☆14Updated last year
• allenai / cached_path
  A file utility for accessing both local and remote files through a unified interface.
  ☆43Updated 2 months ago
• commoncrawl / cc-downloader
  A polite and user-friendly downloader for Common Crawl data
  ☆51Updated last month
• TheoCoombes / crawlingathome
  A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.
  ☆32Updated 2 years ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• Jflick58 / wasm_exec
  WASM-powered sandbox implementation of exec() for safely running dynamic Python code
  ☆36Updated last year
• marimo-team / marimo-labs
  ☆20Updated 2 months ago
• Snowflake-Labs / arctic-embed
  ☆76Updated 7 months ago
• fabiocannizzo / FastBinarySearch
  Fast and vectorizable algorithms for searching in a vector of sorted floating point numbers
  ☆145Updated 7 months ago
• robbmcleod / cpufeature
  Python module for detection of CPU features
  ☆29Updated 5 months ago
• simonw / llm-cluster
  LLM plugin for clustering embeddings
  ☆80Updated last year
• TkTech / json_benchmark
  Python JSON benchmarking and "correctness".
  ☆34Updated last year
• lightonai / ducksearch
  Efficient BM25 with DuckDB 🦆
  ☆54Updated 7 months ago
• NightTsarina / python-rocksdb
  Python bindings for RocksDB
  ☆35Updated 3 years ago
• raphaelsty / neural-tree
  Tree-based indexes for neural-search
  ☆32Updated last year
• jaymody / simpleGPT
  Simple implementation of a GPT (training and inference) in PyTorch.
  ☆12Updated last year
• liujch1998 / infini-gram
  ☆59Updated 3 weeks ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆85Updated 2 months ago
• starkdg / pyphashml
  image perceptual hash based on ML
  ☆28Updated 3 years ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆31Updated last year