Language model tokenization at GB/s
☆4,075Sep 2, 2026Updated this week
Alternatives and similar repositories for gigatoken
Users that are interested in gigatoken are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Apr 6, 2023Updated 3 years ago
- GraalVM GitHub action☆13Jun 25, 2022Updated 4 years ago
- Local Mesos cluster in Vagrant☆12Jun 15, 2015Updated 11 years ago
- Segment a HTML document into structural data☆12Jan 15, 2019Updated 7 years ago
- Demo using Apache Lucene has a reverse geocoder, running as a CLI app via Graal, AWS Lambda or Google Cloud Run☆12Apr 20, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The Clojure programming language☆16Jul 28, 2026Updated last month
- ☆13Oct 16, 2025Updated 10 months ago
- Elevate your TYPO3 website with intelligent, AI-powered content recommendations using advanced NLP☆11Jul 27, 2026Updated last month
- Biological file format specimens for testing packages, and functions to assist in testing.☆16Nov 18, 2025Updated 9 months ago
- A Clojure code formatter using cljfmt built with graalvm.☆16May 7, 2018Updated 8 years ago
- Kafka Connect Vespa sink connector☆17Apr 17, 2025Updated last year
- ☆13Jul 23, 2026Updated last month
- Julia-themed Quarto.☆11Jul 10, 2024Updated 2 years ago
- Data validation and settings management in Julia☆13Apr 15, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Julia package providing curated system images☆12Jan 1, 2025Updated last year
- Clojure wrapper for the `jackson-jq `. Embed `jq` scripts into your app. Compatible with GraalVM native-image.☆21Sep 29, 2023Updated 2 years ago
- Python CLI for alignment-free genomics.☆13May 25, 2026Updated 3 months ago
- Rust coder/decoder for Nucleotide Archival Format (NAF) files.☆10Jan 31, 2025Updated last year
- Various handy transducers☆19May 23, 2024Updated 2 years ago
- ☆15Apr 3, 2024Updated 2 years ago
- text preprocessing library with framework for composable tokenizations☆13Jun 15, 2024Updated 2 years ago
- 🦠🧬 Unraveling Viral Genomes from Metagenomes☆11Jul 30, 2026Updated last month
- Captcha bot for Telegram in Clojure + GraalVM☆16Aug 31, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Bundle and Move Quarto extensions☆16Aug 14, 2022Updated 4 years ago
- Simple command-line argument parsing for Julia☆14Apr 17, 2024Updated 2 years ago
- Fast and generic implementation of the minhash algorithm☆14Jul 8, 2025Updated last year
- ☆15Nov 6, 2024Updated last year
- Search Query Rewriting for Elasticsearch and more! Built on Querqy.☆19May 24, 2025Updated last year
- A Clojure Sandbox for Streaming Data Platforms☆20Jan 1, 2021Updated 5 years ago
- Unit Types for Indexing Strings☆16Feb 7, 2026Updated 6 months ago
- A Tools For Spoon (https://spooncast.net), to Increase Tap Love, Fans, Viewers Of Fans, Report, and etc.☆10Nov 9, 2022Updated 3 years ago
- SymSpell spell checker in Clojure☆25Jan 16, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Phirewall is a PHP based application firewall that provides a PSR-15 middleware.☆19Aug 7, 2026Updated 3 weeks ago
- Query sequence database by HMMs arranged in predefined synteny structure☆20Jun 23, 2026Updated 2 months ago
- Read and write VCF and BCF files☆14Oct 16, 2025Updated 10 months ago
- Assort phage protein sequences into phamilies using MMseqs2☆12Dec 16, 2024Updated last year
- A tool for creating resource prediction models for scientific workflows☆13Feb 27, 2024Updated 2 years ago
- Tutorial of Writing R Packages a Modern Workflow for beginners☆14Feb 17, 2021Updated 5 years ago
- A repo hosting the combined lectures of a course on Fundamentals of Computational Biology☆14Jul 4, 2023Updated 3 years ago