A demonstration of how to train a custom tokenizer similar to TikToken.
☆15Jan 6, 2025Updated last year
Alternatives and similar repositories for train_tokenizer
Users that are interested in train_tokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 训练自己的中文 Embedding 模型☆30Jan 6, 2025Updated last year
- using vlm to ocr pdf with user friendly ui☆14Aug 21, 2025Updated last year
- 《Reinforcement Learning》读书学习与视频分享笔记☆80Apr 1, 2025Updated last year
- learn mojo☆10May 6, 2026Updated 5 months ago
- Basic Web API Examples of NodeServices☆10Aug 15, 2017Updated 9 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Dazzling is a project website generator based on Gatsby and React that's simple, quick, and extensible.☆10Sep 11, 2018Updated 8 years ago
- 国际香港水下机器人，海康威视摄像头分析☆11Mar 22, 2018Updated 8 years ago
- A custom watcher plugin for Elasticsearch that feeds Apache Kafka☆11Mar 9, 2018Updated 8 years ago
- A minimal unmanaged blog app written in Flask☆11Jul 21, 2023Updated 3 years ago
- This is a sample application created with JHipster, with the Cassandra option☆13Sep 18, 2026Updated last month
- 🐱 Felinic design system☆12Updated this week
- ☆14Sep 28, 2026Updated last month
- A vote and lottery App for Wechat☆13Dec 16, 2013Updated 12 years ago
- Berkeley Deep Reinforcement Learning cs294 solution☆12Aug 4, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- mobileNet SSD 基于caffe的前向检测☆10Nov 30, 2018Updated 7 years ago
- llama3 in mojo🔥☆12Jul 25, 2024Updated 2 years ago
- Documentation about useful Software Development tools☆15Dec 26, 2022Updated 3 years ago
- 一起学习Rust☆12Jan 19, 2026Updated 9 months ago
- Makes karaoke from any youtube video link. The method is based on machine learning methods. After dowloading video from Youtube, the audi…☆12Aug 6, 2023Updated 3 years ago
- Chest Xray Classifier using CNNs and Transfer Learning. The jupyter notebook of interest is titled 'Xrays_alt.ipynb'☆11May 18, 2018Updated 8 years ago
- learn-kotlin☆13Nov 24, 2020Updated 5 years ago
- A low cost tts system☆11Jul 7, 2025Updated last year
- Database Tutorial☆11Oct 2, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Snippets for MDB 5 Standard☆10Nov 21, 2022Updated 3 years ago
- 🏳🌈数据科学竞赛练习赛Top解决 方案☆10Dec 20, 2020Updated 5 years ago
- Optimize SGEMM step by step☆10Sep 4, 2024Updated 2 years ago
- ReactJS Component Starter Project☆12Feb 15, 2015Updated 11 years ago
- Nonrigid Iterative Closest Point Algorithm☆10Feb 19, 2016Updated 10 years ago
- React Suspense x React Router Exploration☆17Mar 30, 2018Updated 8 years ago
- Using Carla to make data set similar to Kitti 3D target detection☆10Dec 7, 2020Updated 5 years ago
- IntelligetnScissor implemented by C++.☆12Apr 20, 2018Updated 8 years ago
- Jetson AGX Thor deployment companion for OpenPI pi05 models: JAX-to-PyTorch conversion, ONNX export, TensorRT engine build, validation, a…☆11Apr 6, 2026Updated 6 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Sample radare2 project templates☆17Jan 23, 2026Updated 9 months ago
- This project implements the Titans architecture from the paper "Titans: Learning to Memorize at Test Time" for market data prediction.☆10Jan 19, 2025Updated last year
- Text2Neo4j 是一个遍历文档、从文本中提取关系并将其保存到 Neo4j 数据库中以形成知识图谱的工具。本项目结合了 Dify 和 LLaMA3.1（8B 模型）来高效处理和提取复杂关系。☆24Sep 2, 2026Updated 2 months ago
- android face recognition based on insightface and ncnn , using native opencv method not opencv java api☆13Jul 23, 2022Updated 4 years ago
- Monte Carlo Tree Search (MCTS) ,realize using python☆12Mar 10, 2016Updated 10 years ago
- 🧑🚀 全世界最好的LLM资料总结（语音视频生成、Agent、辅助编程、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型） | Summary of the world's best LLM resources.☆10Jul 28, 2025Updated last year
- Web de la Asociación Python España☆14Nov 14, 2021Updated 4 years ago