目标：构建一个更符合语言学的小而美的 llama 分词器，支持中英日三国语言
☆20Jun 2, 2024Updated last year
Alternatives and similar repositories for chinese-llama-tokenizer
Users that are interested in chinese-llama-tokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 使用单个24G显卡，从0开始训练LLM☆55Jul 9, 2025Updated 10 months ago
- The open-source code for the NeurIPS 2025 paper, "Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learn…☆53Jan 5, 2026Updated 4 months ago
- a unity-package allows to make annotations on arbitrary Unity-scenes of architectural sites☆15Dec 11, 2017Updated 8 years ago
- IEEE Transactions on Affective Computing, 2022☆28Dec 2, 2023Updated 2 years ago
- Better GoLang error handling.☆18Feb 27, 2017Updated 9 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A golang package that implements a distributed tracing capability inspired by Google's Dapper☆12Jan 20, 2017Updated 9 years ago
- PyTorch implementation of GRPO.☆16Apr 21, 2025Updated last year
- ☆10May 21, 2021Updated 5 years ago
- 4-layer(RGBA) parallax hair shader☆16May 8, 2018Updated 8 years ago
- ☆11Jan 26, 2021Updated 5 years ago
- An MCP-capable intelligent RSS feed ingestion and summarization to markdown tool.☆31Feb 4, 2026Updated 3 months ago
- URP14 Shadow Sample☆13Nov 27, 2023Updated 2 years ago
- React Infinite Scroll Component☆14Aug 14, 2018Updated 7 years ago
- Convert claude to chatgpt form api through Slack☆15Jun 7, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Guides to hopefully simplify the process of using ROCm.☆12Sep 26, 2024Updated last year
- UnitychanToonShaderを使用しているマテリアルのパラメータを、特定のシェーダ／ マテリアルに変換するエディタ拡張☆12Mar 17, 2020Updated 6 years ago
- A Swift library for printing a breadcrumb trace on a fatal signal.☆46Jun 26, 2019Updated 6 years ago
- ☆11Jan 6, 2020Updated 6 years ago
- Check if a string is email like☆25Nov 11, 2025Updated 6 months ago
- DX Kit which blurs the line between the code editor and the project.☆11Aug 20, 2016Updated 9 years ago
- ☆12Nov 30, 2020Updated 5 years ago
- 📺 Retrieve episode information from a filename☆12Oct 25, 2017Updated 8 years ago
- A simple hack to use a leap motion device to control a 3D object in an Android application☆25May 26, 2013Updated 13 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This project allow to construct and edit a node graph in a Unity game in playmode (at runtime)☆15Nov 6, 2022Updated 3 years ago
- 传送门☆13Dec 13, 2018Updated 7 years ago
- ☆11Sep 10, 2021Updated 4 years ago
- lightsmile个人的用于爬取网络公开语料数据的mini通用爬虫框架。☆13Sep 30, 2020Updated 5 years ago
- 洛佳的异步内核实验室，第二版☆13Jul 16, 2021Updated 4 years ago
- A Calibre iOS Client.☆14Jan 11, 2026Updated 4 months ago
- Thread-safe state machine library for Objective-C backed by Grand Central Dispatch.☆74May 30, 2013Updated 12 years ago
- ☆13Jul 26, 2021Updated 4 years ago
- Data validation made easy. In code and from Interface Builder.☆54Feb 28, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Automatic arrangement subviews☆16Jun 12, 2021Updated 4 years ago
- train openpilot model from scratch☆15Mar 26, 2021Updated 5 years ago
- wechat android sdk☆11Jul 16, 2015Updated 10 years ago
- 史藏☆13Sep 23, 2016Updated 9 years ago
- A react-native component to show html/image/video fullscreen pages.☆16Jun 16, 2016Updated 9 years ago
- [Deprecated for electrode-ota-server/electrode-ota-ui] Electrode OTA Web/Client UI☆17Oct 17, 2016Updated 9 years ago
- Hadoop YARN monitoring with R☆19Sep 16, 2014Updated 11 years ago