Language model tokenization at GB/s
☆4,125Sep 2, 2026Updated last month
Alternatives and similar repositories for gigatoken
Users that are interested in gigatoken are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Docker for EXT:solr☆11Aug 19, 2016Updated 10 years ago
- Github Action to run clojure.test by Babashka☆14Dec 29, 2021Updated 4 years ago
- ☆13Sep 17, 2026Updated 3 weeks ago
- Datastores for reads, not your papa's FASTQ files.☆11Jul 28, 2023Updated 3 years ago
- Julia-themed Quarto.☆11Jul 10, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Julia package providing curated system images☆13Jan 1, 2025Updated last year
- Clojure wrapper for the `jackson-jq `. Embed `jq` scripts into your app. Compatible with GraalVM native-image.☆21Sep 29, 2023Updated 3 years ago
- Python CLI for alignment-free genomics.☆13May 25, 2026Updated 4 months ago
- Representing biological sequences as Markov chains☆10Dec 9, 2024Updated last year
- Rust coder/decoder for Nucleotide Archival Format (NAF) files.☆10Jan 31, 2025Updated last year
- Various handy transducers☆19May 23, 2024Updated 2 years ago
- TYPO3 extension providing a frontend for Solr indexes.☆17Sep 21, 2026Updated 3 weeks ago
- text preprocessing library with framework for composable tokenizations☆13Jun 15, 2024Updated 2 years ago
- 🦠🧬 Unraveling Viral Genomes from Metagenomes☆11Jul 30, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Clojure native implementation of HNSW algorithm☆17Sep 5, 2026Updated last month
- Bundle and Move Quarto extensions☆16Aug 14, 2022Updated 4 years ago
- Simple command-line argument parsing for Julia☆14Apr 17, 2024Updated 2 years ago
- Fast and generic implementation of the minhash algorithm☆14Jul 8, 2025Updated last year
- Build documentation for your Julia package with Quarto!☆15Oct 25, 2025Updated 11 months ago
- Search Query Rewriting for Elasticsearch and more! Built on Querqy.☆19May 24, 2025Updated last year
- Unit Types for Indexing Strings☆16Feb 7, 2026Updated 8 months ago
- A Tools For Spoon (https://spooncast.net), to Increase Tap Love, Fans, Viewers Of Fans, Report, and etc.☆10Nov 9, 2022Updated 3 years ago
- SymSpell spell checker in Clojure☆27Jan 16, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Sketch a pipeline of targets in an interactive web app☆18Apr 2, 2024Updated 2 years ago
- Query sequence database by HMMs arranged in predefined synteny structure☆21Jun 23, 2026Updated 3 months ago
- Read and write VCF and BCF files☆14Oct 16, 2025Updated 11 months ago
- Assort phage protein sequences into phamilies using MMseqs2☆12Dec 16, 2024Updated last year
- A tool for creating resource prediction models for scientific workflows☆13Feb 27, 2024Updated 2 years ago
- Tutorial of Writing R Packages a Modern Workflow for beginners☆15Feb 17, 2021Updated 5 years ago
- ☆16Sep 4, 2024Updated 2 years ago
- A repo hosting the combined lectures of a course on Fundamentals of Computational Biology☆14Jul 4, 2023Updated 3 years ago
- Wrapper to protein secondary structure calculation packages☆13Aug 25, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Visualize microbial evolution at the SNP level!☆18Aug 12, 2025Updated last year
- ☆27May 25, 2024Updated 2 years ago
- Create Interactive Image Comparators from R with the 'image-compare-viewer' Javascript Library☆15Mar 28, 2022Updated 4 years ago
- Clojure wrapper for Structurizr library in Java.☆22Feb 1, 2022Updated 4 years ago
- ☆12Aug 13, 2024Updated 2 years ago
- Translate Latex Formulas to R Code☆14Sep 19, 2021Updated 5 years ago
- Symbolic modeling in Julia!☆12Aug 3, 2026Updated 2 months ago