A clone of OpenAI's Tokenizer page for HuggingFace Models
β46Nov 13, 2023Updated 2 years ago
Alternatives and similar repositories for tokenwiz
Users that are interested in tokenwiz are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- RASP-L in Haskell for my fellow rascalsβ20Dec 3, 2023Updated 2 years ago
- π£ππ A simple utility to draft scheduling emails.β12Sep 13, 2023Updated 2 years ago
- An agentic tool to configure Dockerfiles for any repoβ76Apr 30, 2026Updated last month
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1β¦β14Jan 19, 2024Updated 2 years ago
- Web Browsing Agent Appβ51Oct 31, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Partial JSON parser extracted from OpenAI's vendored version.β15Jul 18, 2025Updated 11 months ago
- Janus is an opensource IA for Star Citizenβ11Dec 23, 2023Updated 2 years ago
- A webhook that integrates the W&B model registry with Modal Labsβ15Dec 24, 2023Updated 2 years ago
- Synchronicity lets you interoperate with asynchronous Python APIs.β139Updated this week
- Using modal.com to process FineWeb-edu dataβ20Apr 11, 2026Updated 2 months ago
- Eden is building autonomous creative agents.β30May 28, 2026Updated 3 weeks ago
- A comprehensive deep dive into the world of tokensβ229Jun 24, 2024Updated last year
- Privacy-preserving k-means clustering on data owned by multiple partiesβ14May 10, 2016Updated 10 years ago
- β16Jun 20, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean β’ AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- various experiments for scaling inference time compute with small reasoning modelsβ17Jan 16, 2025Updated last year
- LLM plugin for models hosted by Anyscale Endpointsβ35Apr 22, 2024Updated 2 years ago
- codellama on CPU without Dockerβ25Feb 8, 2024Updated 2 years ago
- A Python package to dynamically load functions for OpenAI Assistantβ55Dec 6, 2023Updated 2 years ago
- β26Mar 11, 2023Updated 3 years ago
- A fully modular framework to make Reinforcement Learning quick and easyβ46Apr 25, 2026Updated last month
- The very first artist assistantβ23Jul 7, 2023Updated 2 years ago
- An app for generating promptsβ28Apr 19, 2026Updated last month
- A collection of tools for your LLMs that run on Modalβ26Feb 28, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- β40Mar 25, 2024Updated 2 years ago
- A curated list of awesome HONC projectsβ20Mar 1, 2025Updated last year
- β52May 26, 2026Updated 3 weeks ago
- Implementing FastSent in theanoβ12May 2, 2016Updated 10 years ago
- β10Apr 21, 2024Updated 2 years ago
- Use LLMs to clean your gmail inboxβ22Dec 23, 2023Updated 2 years ago
- Ollama API client in ECMAScript / JavaScript / ESM.β11Sep 18, 2023Updated 2 years ago
- Python scripts to finetune GPT 3.5β20Oct 4, 2023Updated 2 years ago
- β21Sep 27, 2023Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer β’ AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Very simple syntax highlightingβ21May 3, 2024Updated 2 years ago
- β74Sep 5, 2023Updated 2 years ago
- Track the progress of LLM context utilisationβ56Apr 14, 2025Updated last year
- β30Apr 26, 2024Updated 2 years ago
- It is almost the best 3B model in the current open source industry, surpassing Dolly v2-3b, open lama-3b, and even outperforming the Eleuβ¦β15Jul 24, 2023Updated 2 years ago
- β11Dec 23, 2023Updated 2 years ago
- Multiplexer for AI protocols, agents, models, and toolsβ24Aug 8, 2025Updated 10 months ago