基于 BPE 实现的中文分词。优化:预处理,并行计算,多字词,多词表
☆14May 14, 2022Updated 4 years ago
Alternatives and similar repositories for bpe_v3
Users that are interested in bpe_v3 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [AAAI 2023] Official implementation of FiTs: Fine-grained Two-stage Training for Knowledge Base Question Answering☆11Mar 10, 2023Updated 3 years ago
- ☆12Apr 25, 2025Updated last year
- Evaluation code for benchmarking VLMs in traditional chinese understanding☆14Dec 22, 2025Updated 7 months ago
- An Efficent BPE Algorithm Faster then Hugging Face Tokenizer's Implementation☆13Sep 9, 2024Updated last year
- Taiwanese Mandarin LLM Project☆19May 26, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 一个基于react16,react-router4,redux4的webapp。主要功能类似于朋友圈,动态编辑,图片上传,图片预览,点赞,评论,用户登录注册,用户日志管理,用户信息管理。服务等是采用express ,数据持久化采用的是mongodb。功能相对来说比较简单,主…☆10Apr 15, 2021Updated 5 years ago
- Advanced audio player component (audix) for Streamlit with waveform visualization and region selection☆14Jun 24, 2025Updated last year
- TransDTI: Transformer-based language models for estimating DTIs and building a drug-recommendation workflow☆14Oct 26, 2022Updated 3 years ago
- Demonstration of Skeleton visualization in RViz☆11Oct 21, 2022Updated 3 years ago
- Tools for speech recognition☆11Jun 24, 2017Updated 9 years ago
- ☆18Feb 6, 2025Updated last year
- 校园音乐征集投票系统 A system for electing annual school music☆10Jul 7, 2026Updated 2 weeks ago
- Instant messaging with a neural network☆11Nov 13, 2016Updated 9 years ago
- 图片分享app☆15Feb 17, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ECCV'24] UNIT: Backdoor Mitigation via Automated Neural Distribution Tightening☆10Dec 18, 2025Updated 7 months ago
- Taurix OS kernel. Taurix 系统内核,操作系统原理实(xjb)践(写)☆12Dec 20, 2020Updated 5 years ago
- 量化交易网站,软工三大作业迭代三,团队项目☆11Mar 8, 2018Updated 8 years ago
- 《自己动手设计数据库》摘录☆10Oct 28, 2016Updated 9 years ago
- Go package for getting docker container resource limit&usage metrics.☆11Apr 20, 2018Updated 8 years ago
- 这是一个可通过网页远程登录管理、可接入讯飞星火、ChatGPT等大语言模型的微信聊天机器人,使用微信网页版协议。☆16Feb 20, 2024Updated 2 years ago
- NewsApp包含客户端源码、服务端源码、数据库文件。 基于Miscrosoft人工智能项目ProjectOxford中的Recognition Emotion做的, 主要是基于用户的面部表情来推送不同类别的新闻。 Emotion API可以参考:https://www.p…☆10Mar 2, 2016Updated 10 years ago
- A WAV encoding/decoding library for Go☆10May 25, 2019Updated 7 years ago
- Read, write, and modify PDF files using the Go programming language☆16Mar 24, 2014Updated 12 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 使用Sentencepiece对中文语料进行分词☆13Nov 30, 2023Updated 2 years ago
- A Markov chain algorithm that generates junk text.☆16Mar 22, 2018Updated 8 years ago
- KnowLA: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptation, NAACL 2024☆16Jul 29, 2024Updated last year
- A distributed token-bucket rate limiter backed by Redis.☆19Jun 19, 2017Updated 9 years ago
- OpenCV for Raspberry Pi 3☆18Apr 13, 2019Updated 7 years ago
- 「城语」APP基于A级景区、历史古迹、文物保护单位等基础数据,利用先进的大模型能力实现智能化的Citywalk 路线规划,包括设计一条路线、生成路线攻略、生成景点的推荐理由等三大核心功能;利用大模型减少了人工编辑和推荐的工作量,并可以根据游客的需求进行个性化定制,提升了游客…☆19Feb 20, 2024Updated 2 years ago
- 使用BiLSTM+CRF进行邮寄地址识别任务的开发☆18Mar 8, 2022Updated 4 years ago
- A power sql tools for jupyterlab☆22May 2, 2024Updated 2 years ago
- Programming for NLP Project - Implement a basic n-gram language model and generate sentence using beam search☆11Mar 10, 2020Updated 6 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 同济大学计科机器学习大作业☆10Mar 22, 2025Updated last year
- 基于MFCC特征构建单核GMM的0-9独立词语音识别,MFCC,GMM,sklearn,Isolated word recognition。☆10Nov 18, 2020Updated 5 years ago
- Reverse Polish Notation calculator for ESP8266 & ESP32 microcontrollers.☆11Feb 28, 2020Updated 6 years ago
- This repository is about how to implement your Intel realsense camera for skeleton tracking in Linux system.☆11Oct 22, 2020Updated 5 years ago
- This repository provides scripts for evaluating NLP models on the LEXTREME benchmark, a set of diverse multilingual tasks in legal NLP☆26Dec 28, 2023Updated 2 years ago
- Implementation of "Binary Graph Convolutional Network", CVPR 2021, and TPAMI 2024.☆26Apr 8, 2024Updated 2 years ago
- gorilla paper encode in C language☆14Apr 18, 2023Updated 3 years ago