Alternatives and similar repositories for tokenizer:

Users that are interested in tokenizer are comparing it to the libraries listed below

• jmont-dev / ollama-hpp
  Modern, Header-only C++ bindings for the Ollama API.
  ☆74Updated 2 months ago
• unevens / avec
  A little library for using SIMD instructions for x86 and ARM, wrapping Agner Fog's vectorclass for x86 and filling some of its functional…
  ☆16Updated 3 years ago
• WindowsNT / SpeechRec
  Continuous Dictation Speech Recognition and Speech Synthesis in Win32
  ☆17Updated 4 years ago
• panmasuo / voice-activity-detection
  Voice activity detection algorithm written in C
  ☆14Updated 9 months ago
• Peter-Chou / transformer_cpp_tokenizers
  transformer tokenizers (e.g. BERT tokenizer) in C++ (WIP)
  ☆16Updated 2 years ago
• dbry / audio-resampler
  Simple audio resampler targeting embedded systems
  ☆39Updated 2 weeks ago
• plutoprint / plutobook
  Paged HTML Rendering Library (WIP)
  ☆15Updated last month
• WindowsNT / eq
  The Equalizer Design, Win32 + Direct2D
  ☆20Updated 4 years ago
• rbrich / xcikit
  Collection of C++ libraries for drawing 2D graphics, rendering text, and more.
  ☆19Updated last month
• sepnic / litevad
  Speech-end detection library, based on WebRTC's VAD engine
  ☆21Updated 7 months ago
• dbry / slac
  Simple Lossless Audio Compressor
  ☆75Updated last week
• EdVince / llm-cpp
  ☆32Updated 6 months ago
• ShiftMediaProject / SDL
  Unofficial SDL with added custom native Visual Studio project build tools. SDL: SDL Simple DirectMedia Layer is a cross-platform develop…
  ☆11Updated 2 months ago
• michaelrsweet / htmlcss
  A lightweight HTML and CSS Parser in C
  ☆62Updated 2 years ago
• RealTimeChris / Json-Performance
  A few C++ json-library benchmarks, of the fastest few libraries.
  ☆22Updated this week
• yui0 / ugemm
  GEMM
  ☆10Updated last year
• neacsum / utf8
  Simple Library for Internationalization
  ☆46Updated this week
• maxilevi / vits.cpp
  a cpp ggml port of "VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech." for use in mobile…
  ☆35Updated 5 months ago
• cdevelop / libquickmail
  from https://sourceforge.net/projects/libquickmail/
  ☆12Updated 4 years ago
• cpuimage / cpuFFT
  A Simple and Efficient FFT Implementation in C
  ☆10Updated 6 years ago
• magicse / ncnn-hifi-GAN
  ncnn HiFi-GAN
  ☆26Updated 4 months ago
• sevagh / umx.cpp
  C++17 port of Open-Unmix-PyTorch with streaming LSTM inference, ggml, quantization, and Eigen
  ☆40Updated last year
• mhx / libembedded
  Modern C++ for Embedded Systems
  ☆14Updated 2 years ago
• medusalix / MiniVST
  Minimalistic Windows-only VST2 Host
  ☆22Updated 5 years ago
• IntendedConsequence / vadc
  Uses the excellent silero VAD with onnxruntime C api for fast detection of audio segments with speech
  ☆12Updated 4 months ago
• cpuimage / FFmpeg_Loudness
  Audio Loudness Normalization Filter Port From FFmpeg
  ☆11Updated 5 years ago
• lovemefan / paraformer.cpp
  Port of Funasr's Paraformer model in C/C++
  ☆27Updated 7 months ago
• WindowsNT / chatgpt-api
  A Win32 implementation of the chat-gpt API for your Windows applications
  ☆29Updated last year
• karel-burda / function-loader
  Header-only library that can execute functions in a shared library and provides wrappers around these
  ☆15Updated 3 years ago
• craflin / libnstd
  An easy to use and fast non-standard standard library replacement for C++.
  ☆33Updated 2 weeks ago