Language model tokenization at GB/s
☆3,973Aug 6, 2026Updated last week
Alternatives and similar repositories for gigatoken
Users that are interested in gigatoken are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tree-based indexes for neural-search☆33Mar 4, 2024Updated 2 years ago
- GraalVM GitHub action☆13Jun 25, 2022Updated 4 years ago
- Demo using Apache Lucene has a reverse geocoder, running as a CLI app via Graal, AWS Lambda or Google Cloud Run☆12Apr 20, 2021Updated 5 years ago
- Linguistic slovak stemmer based on Lucene stemmers☆11Apr 15, 2016Updated 10 years ago
- The Solr Package Directory and Sanctuary☆13May 28, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The Clojure programming language☆16Jul 28, 2026Updated 2 weeks ago
- Quarkus Tika extension☆14Jul 22, 2026Updated 3 weeks ago
- Morphological analysis of Finnish language for Java☆14Feb 20, 2024Updated 2 years ago
- Github Action to run clojure.test by Babashka☆14Dec 29, 2021Updated 4 years ago
- Biological file format specimens for testing packages, and functions to assist in testing.☆16Nov 18, 2025Updated 8 months ago
- Kafka Connect Vespa sink connector☆17Apr 17, 2025Updated last year
- ☆13Jul 23, 2026Updated 3 weeks ago
- Datastores for reads, not your papa's FASTQ files.☆11Jul 28, 2023Updated 3 years ago
- Julia-themed Quarto.☆11Jul 10, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Context Mapper Command Line Interface (CLI)☆21Jun 13, 2025Updated last year
- Data validation and settings management in Julia☆13Apr 15, 2021Updated 5 years ago
- Julia package providing curated system images☆12Jan 1, 2025Updated last year
- Clojure wrapper for the `jackson-jq `. Embed `jq` scripts into your app. Compatible with GraalVM native-image.☆21Sep 29, 2023Updated 2 years ago
- Python CLI for alignment-free genomics.☆13May 25, 2026Updated 2 months ago
- RAxML Next Generation: faster, easier-to-use and more flexible☆10Mar 26, 2026Updated 4 months ago
- Various handy transducers☆19May 23, 2024Updated 2 years ago
- ☆15Apr 3, 2024Updated 2 years ago
- TYPO3 extension providing a frontend for Solr indexes.☆17Jun 30, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- KalDB is a cloud-native polystore for search and analytics☆43Jul 24, 2026Updated 2 weeks ago
- Captcha bot for Telegram in Clojure + GraalVM☆16Aug 31, 2023Updated 2 years ago
- Native implementation of HNSW algorithms (pure-hnsw, pcaf, ivf-hnsw, p-hnsw)☆16Aug 15, 2025Updated 11 months ago
- StringEncrypt allows you to encrypt strings and files using a randomly generated algorithm, generating a unique decryption code (so-calle…☆23Apr 29, 2026Updated 3 months ago
- Bundle and Move Quarto extensions☆16Aug 14, 2022Updated 3 years ago
- Simple command-line argument parsing for Julia☆14Apr 17, 2024Updated 2 years ago
- Echo client-server components to evaluate Project Loom virtual threads.☆17Jan 3, 2022Updated 4 years ago
- Fast and generic implementation of the minhash algorithm☆14Jul 8, 2025Updated last year
- Build documentation for your Julia package with Quarto!☆15Oct 25, 2025Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Search Query Rewriting for Elasticsearch and more! Built on Querqy.☆19May 24, 2025Updated last year
- A Gene Finder framework for Julia.☆15Jan 16, 2026Updated 6 months ago
- Solr clients/tools for Elasticsearch☆16Oct 25, 2019Updated 6 years ago
- A Tools For Spoon (https://spooncast.net), to Increase Tap Love, Fans, Viewers Of Fans, Report, and etc.☆10Nov 9, 2022Updated 3 years ago
- SymSpell spell checker in Clojure☆25Jan 16, 2023Updated 3 years ago
- Realtime log processing with Fluentd and NSQ☆14Mar 28, 2019Updated 7 years ago
- Tool to make crude translations of Python code to Julia.☆16Aug 6, 2023Updated 3 years ago