Language model tokenization at GB/s
☆1,892Jul 22, 2026Updated this week
Alternatives and similar repositories for gigatoken
Users that are interested in gigatoken are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Rust-native time-series table format with gap/overlap tracking and SQL queries☆16Mar 18, 2026Updated 4 months ago
- The frontend of Penguin Statistics' embed widget. Provides embeddable statistical data to external websites.☆11Apr 13, 2023Updated 3 years ago
- A fully differentiable implementation of SHA256☆11Nov 12, 2021Updated 4 years ago
- ☆16Jun 14, 2026Updated last month
- A multiprocessing-friendly Python mock object☆10Aug 31, 2017Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Tree-based indexes for neural-search☆33Mar 4, 2024Updated 2 years ago
- ☆16Apr 6, 2023Updated 3 years ago
- Migrate off of Docker Hub with Skopeo☆14Mar 15, 2023Updated 3 years ago
- Procedurally generated Oblique Strategies for writing your own Oblique Strategies☆13May 26, 2022Updated 4 years ago
- Docker for EXT:solr☆11Aug 19, 2016Updated 9 years ago
- Hypothesis strategies for various Pytorch structures (including tensors and modules).☆13Jun 29, 2026Updated 3 weeks ago
- GraalVM GitHub action☆13Jun 25, 2022Updated 4 years ago
- Marching Cubes (ambiguity resolved) implemented in C++☆16Jul 25, 2021Updated 4 years ago
- Vibe with Xiaomi AI Speaker☆23Feb 25, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- An npm package to convert US state abbreviations to full names and back☆10Jul 17, 2024Updated 2 years ago
- ☆12Feb 23, 2024Updated 2 years ago
- ☆10Jun 6, 2019Updated 7 years ago
- Local Mesos cluster in Vagrant☆12Jun 15, 2015Updated 11 years ago
- Simple ticket reservation system for multi-occurrence events.☆11Dec 30, 2022Updated 3 years ago
- Translates foreign language PDFS☆13Oct 1, 2018Updated 7 years ago
- Segment a HTML document into structural data☆12Jan 15, 2019Updated 7 years ago
- 聚合处理的《明日方舟》游戏数据。☆11Updated this week
- PRTS Widgets 构建仓库☆16Jul 17, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Open Source Audio News Subscription Service (Google Trends, Hacker News & more).☆17Apr 1, 2025Updated last year
- Demo using Apache Lucene has a reverse geocoder, running as a CLI app via Graal, AWS Lambda or Google Cloud Run☆12Apr 20, 2021Updated 5 years ago
- Linguistic slovak stemmer based on Lucene stemmers☆11Apr 15, 2016Updated 10 years ago
- The Solr Package Directory and Sanctuary☆13May 28, 2026Updated last month
- The Clojure programming language☆16Updated this week
- Quarkus Tika extension☆14Updated this week
- ☆13Oct 16, 2025Updated 9 months ago
- command-line tool to merge package.json files☆12Feb 16, 2022Updated 4 years ago
- Quarkus Lucene Extension☆16Apr 8, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Elevate your TYPO3 website with intelligent, AI-powered content recommendations using advanced NLP☆11Updated this week
- Morphological analysis of Finnish language for Java☆13Feb 20, 2024Updated 2 years ago
- Github Action to run clojure.test by Babashka☆14Dec 29, 2021Updated 4 years ago
- Finnish language analysis for Elasticsearch using Raudikko☆12Mar 4, 2026Updated 4 months ago
- Application configuration and scripts for search on https://docs.vespa.ai/☆12Jul 10, 2026Updated 2 weeks ago
- A Clojure code formatter using cljfmt built with graalvm.☆16May 7, 2018Updated 8 years ago
- Quarkus extension for the Jackson JQ library☆16Updated this week