Language model tokenization at GB/s
☆4,110Sep 2, 2026Updated 3 weeks ago
Alternatives and similar repositories for gigatoken
Users that are interested in gigatoken are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Rust-native time-series table format with gap/overlap tracking and SQL queries☆17Sep 9, 2026Updated 2 weeks ago
- ☆16Jul 23, 2026Updated 2 months ago
- Linguistic slovak stemmer based on Lucene stemmers☆11Apr 15, 2016Updated 10 years ago
- The Solr Package Directory and Sanctuary☆13May 28, 2026Updated 3 months ago
- The Clojure programming language☆16Sep 2, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Quarkus Tika extension☆14Aug 24, 2026Updated 3 weeks ago
- Morphological analysis of Finnish language for Java☆15Feb 20, 2024Updated 2 years ago
- Github Action to run clojure.test by Babashka☆14Dec 29, 2021Updated 4 years ago
- Biological file format specimens for testing packages, and functions to assist in testing.☆16Nov 18, 2025Updated 10 months ago
- A Clojure code formatter using cljfmt built with graalvm.☆16May 7, 2018Updated 8 years ago
- ☆13Updated this week
- Datastores for reads, not your papa's FASTQ files.☆11Jul 28, 2023Updated 3 years ago
- Julia-themed Quarto.☆11Jul 10, 2024Updated 2 years ago
- Context Mapper Command Line Interface (CLI)☆21Jun 13, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Julia package providing curated system images☆13Jan 1, 2025Updated last year
- Clojure wrapper for the `jackson-jq `. Embed `jq` scripts into your app. Compatible with GraalVM native-image.☆21Sep 29, 2023Updated 2 years ago
- Python CLI for alignment-free genomics.☆13May 25, 2026Updated 3 months ago
- Rust coder/decoder for Nucleotide Archival Format (NAF) files.☆10Jan 31, 2025Updated last year
- ☆15Apr 3, 2024Updated 2 years ago
- text preprocessing library with framework for composable tokenizations☆13Jun 15, 2024Updated 2 years ago
- Captcha bot for Telegram in Clojure + GraalVM☆16Aug 31, 2023Updated 3 years ago
- Clojure native implementation of HNSW algorithm☆17Sep 5, 2026Updated 2 weeks ago
- StringEncrypt allows you to encrypt strings and files using a randomly generated algorithm, generating a unique decryption code (so-calle…☆24Apr 29, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Bundle and Move Quarto extensions☆16Aug 14, 2022Updated 4 years ago
- Fast and generic implementation of the minhash algorithm☆14Jul 8, 2025Updated last year
- Build documentation for your Julia package with Quarto!☆15Oct 25, 2025Updated 10 months ago
- Search Query Rewriting for Elasticsearch and more! Built on Querqy.☆19May 24, 2025Updated last year
- A Gene Finder framework for Julia.☆15Jan 16, 2026Updated 8 months ago
- A Tools For Spoon (https://spooncast.net), to Increase Tap Love, Fans, Viewers Of Fans, Report, and etc.☆10Nov 9, 2022Updated 3 years ago
- SymSpell spell checker in Clojure☆25Jan 16, 2023Updated 3 years ago
- Realtime log processing with Fluentd and NSQ☆14Mar 28, 2019Updated 7 years ago
- A simple Java library for FRC to develop more complex programs with less code☆10Jan 8, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Sketch a pipeline of targets in an interactive web app☆18Apr 2, 2024Updated 2 years ago
- Query sequence database by HMMs arranged in predefined synteny structure☆21Jun 23, 2026Updated 3 months ago
- Read and write VCF and BCF files☆14Oct 16, 2025Updated 11 months ago
- A tool for creating resource prediction models for scientific workflows☆13Feb 27, 2024Updated 2 years ago
- ☆16Sep 4, 2024Updated 2 years ago
- A repo hosting the combined lectures of a course on Fundamentals of Computational Biology☆14Jul 4, 2023Updated 3 years ago
- ☆11Sep 16, 2021Updated 5 years ago