目标:构建一个更符合语言学的小而美的 llama 分词器,支持中英日三国语言
☆19Jun 2, 2024Updated 2 years ago
Alternatives and similar repositories for chinese-llama-tokenizer
Users that are interested in chinese-llama-tokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 使用单个24G显卡,从0开始训练LLM☆54Jul 9, 2025Updated last year
- Data and Code for the paper "FinanceMath: Knowledge-Intensive Math Reasoning in Finance Domains"☆24Aug 10, 2024Updated last year
- The official implementation of ACL'24 paper: Synergistic Interplay between Search and Large Language Models for Information Retrieval.☆36Jun 6, 2024Updated 2 years ago
- The official Github repository for paper "R^2AG: Incorporating Retrieval Information into Retrieval Augmented Generation" (EMNLP 2024 Fin…☆41Dec 6, 2024Updated last year
- a unity-package allows to make annotations on arbitrary Unity-scenes of architectural sites☆15Dec 11, 2017Updated 8 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆11May 30, 2026Updated last month
- Signed Distance Field Map Generator☆10Jun 19, 2023Updated 3 years ago
- A golang package that implements a distributed tracing capability inspired by Google's Dapper☆12Jan 20, 2017Updated 9 years ago
- ☆10May 21, 2021Updated 5 years ago
- MMD Camera Path Vmd's File For Unity3D☆12Sep 19, 2017Updated 8 years ago
- Clone of ActiveRecord::Inflect. Originally created by Chris Farmiloe. Updated to use with Go 1.☆29Jul 23, 2014Updated 11 years ago
- React Conf 2016 API☆10Feb 23, 2016Updated 10 years ago
- Extension for the SenTestingKit for asynchronous testing☆104May 20, 2013Updated 13 years ago
- React Infinite Scroll Component☆14Aug 14, 2018Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Build a simple basic multimodal large model from scratch. 从零搭建一个简单的基础多模态大模型🤖☆49Jun 19, 2024Updated 2 years ago
- Guides to hopefully simplify the process of using ROCm.☆12Sep 26, 2024Updated last year
- Raspberry Pi 4 Image☆12Oct 25, 2024Updated last year
- UnitychanToonShaderを使用しているマテリアルのパラメータを、特定のシェーダ/マテリアルに変換するエディタ拡張☆12Mar 17, 2020Updated 6 years ago
- A Swift library for printing a breadcrumb trace on a fatal signal.☆46Jun 26, 2019Updated 7 years ago
- ☆14Jul 30, 2019Updated 6 years ago
- DX Kit which blurs the line between the code editor and the project.☆11Aug 20, 2016Updated 9 years ago
- 🔨 An application to create and share beautiful images of your source code (iOS and macOS)☆12Jan 22, 2024Updated 2 years ago
- A simple hack to use a leap motion device to control a 3D object in an Android application☆25May 26, 2013Updated 13 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- tools and utilities for working with xcode/ios projects☆11Mar 18, 2019Updated 7 years ago
- This project allow to construct and edit a node graph in a Unity game in playmode (at runtime)☆15Nov 6, 2022Updated 3 years ago
- 传送门☆13Dec 13, 2018Updated 7 years ago
- ☆11Sep 10, 2021Updated 4 years ago
- node client for etcd (api v3)☆10Apr 12, 2017Updated 9 years ago
- lightsmile个人的用于爬取网络公开语料数据的mini通用爬虫框架。☆13Sep 30, 2020Updated 5 years ago
- 洛佳的异步内核实验室,第二版☆13Jul 16, 2021Updated 4 years ago
- A Calibre iOS Client.☆14Jan 11, 2026Updated 5 months ago
- Thread-safe state machine library for Objective-C backed by Grand Central Dispatch.☆75May 30, 2013Updated 13 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Silence "Class Foo is implemented in both" warnings☆16Jul 17, 2022Updated 3 years ago
- ☆13Jul 26, 2021Updated 4 years ago
- Source code for the StealthAssist iOS app. Wirelessly connects your iPhone to the Valentine One radar detector.☆16Oct 17, 2015Updated 10 years ago
- 中文语料库-每日自动更新版 ── 爬虫代码☆15Aug 8, 2020Updated 5 years ago
- 史藏☆13Sep 23, 2016Updated 9 years ago
- VMCProtocolの受信内容をVMC互換で表示するソフトウェア。 バーチャルモーションキャプチャーとほぼ同等の表示を実現しようとします。☆13Jul 26, 2020Updated 5 years ago
- React 逐层渲染Component,用于异步渲染,提升用户体验☆42Nov 15, 2015Updated 10 years ago