A demonstration of how to train a custom tokenizer similar to TikToken.
☆15Jan 6, 2025Updated last year
Alternatives and similar repositories for train_tokenizer
Users that are interested in train_tokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- It is a Web-based Platform where Customer can book a car for rent along with other features. It also include Car Rental Management featur…☆10Jan 13, 2020Updated 6 years ago
- “小谢记账本”是一个基本的个人记账系统，拥有账户注册登录系统，可以实现记录账单，删除某条账单，查询某一特定类型的账单，查询某日，某月，某年账单，并根据账单数据生成对应图表的功能。☆17Dec 19, 2024Updated last year
- babyLM WhisBERT code☆19May 27, 2024Updated 2 years ago
- Repository for predicting conductivities through Arrhenius parameters for polymer electrolytes.☆27Jul 29, 2024Updated last year
- ☆18Feb 20, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code implementation for the paper titled MusicLIME: Explainable Multimodal Music Understanding☆24Jan 27, 2025Updated last year
- This is the repository for the source code of the paper "Structure-Aware Single-Source Generalization with Pixel-Level Disentanglement fo…☆18Dec 22, 2024Updated last year
- 结合《Java编程思想》整理的Java知识点脑图☆11Jun 28, 2020Updated 6 years ago
- Joint optic disc and optic cup segmentation based on boundary prior and adversarial learning☆15Jan 18, 2023Updated 3 years ago
- Official repostory of the paper: Masked Scene Modeling (CVPR 2025)☆18Dec 13, 2025Updated 7 months ago
- Shopery - an organic grocery ecommerce html template☆12Aug 24, 2023Updated 2 years ago
- [ICML 2026] PASA: A Principled Embedding-Space Watermarking Approach for LLM-Generated Text under Semantic-Invariant Attacks☆23May 13, 2026Updated 2 months ago
- AI assistant built with Streamlit, NVIDIA NIM (LLaMa 3.3:70B) / Ollama, and Model Control Protocol (MCP).☆43Feb 9, 2025Updated last year
- Personal learning journey from Sheryians Cohort 2.0, covering full-stack web development, DSA with JavaScript, generative AI, aptitude pr…☆22Mar 12, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- OpenMaskDINO3D : Reasoning 3D Segmentation via Large Language Model☆17Sep 15, 2025Updated 10 months ago
- gRPC login demo, written in modern C++ and built with Bazel☆11Oct 3, 2020Updated 5 years ago
- Glaucoma Detection based on Optic Cup and Disc Segmentation using U-Net☆12May 1, 2023Updated 3 years ago
- Java S2I Builder image☆15Aug 12, 2025Updated 11 months ago
- Car Rental System using Django FrameWork☆20Jul 15, 2023Updated 3 years ago
- Code for the 2025 ACL publication "Fine-Tuning on Diverse Reasoning Chains Drives Within-Inference CoT Refinement in LLMs"☆32Jun 25, 2025Updated last year
- Original source code for Alex Libby's Practical Next.js for E-Commerce☆17Sep 12, 2023Updated 2 years ago
- coze api to openai☆15Sep 1, 2024Updated last year
- AgentForge is a powerful and flexible signal-driven workflow framework designed for building intelligent, dynamic, and adaptive systems.☆18Feb 5, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The RouteBoxer class generates a set of LatLngBounds objects that are guaranteed to cover every point within a specified distance of a pa…☆19Nov 11, 2015Updated 10 years ago
- 训练自己的中文 Embedding 模型☆30Jan 6, 2025Updated last year
- Train LoRA using Microsoft's official implementation with Stable Diffusion models.☆34May 9, 2023Updated 3 years ago
- Swiss Ephemeris binding for react-native☆15Jan 19, 2026Updated 6 months ago
- Solutions of the problems NER and RE in the domain of business documents with the BERT+CRF model.☆16Jan 16, 2023Updated 3 years ago
- Flash Sculptor: Modular 3D Worlds from Objects☆33Apr 13, 2025Updated last year
- This is HAUE-CS-WIKI（河南工程学院计算机学习指南） project, which collects and organizes some computer-related course guides that I have personally stud…☆40Mar 4, 2025Updated last year
- Python code & Cloudflare worker for Mistral-OCR☆12Mar 8, 2025Updated last year
- ☆17Aug 26, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A simple demo of e-commerce for wechat mini program☆24Dec 11, 2022Updated 3 years ago
- published by Packt☆23Jan 19, 2026Updated 6 months ago
- ☆31Nov 18, 2025Updated 8 months ago
- An abstraction library for building domain-specific intelligent agents based on Large Language Models (LLMs). LLMAgent provides a core ar…☆27Feb 5, 2026Updated 5 months ago
- 全球AI攻防挑战赛—赛道一：大模型生图安全疫苗注入第二名解题方案☆27Nov 7, 2024Updated last year
- A simple but useful chatbot based on gpt-3.5-turbo and whisper-1.☆14Mar 6, 2023Updated 3 years ago
- openai realtime webrtc demo☆23Jan 5, 2025Updated last year