基于 BPE 实现的中文分词。优化:预处理,并行计算,多字词,多词表
☆14May 14, 2022Updated 4 years ago
Alternatives and similar repositories for bpe_v3
Users that are interested in bpe_v3 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [AAAI 2023] Official implementation of FiTs: Fine-grained Two-stage Training for Knowledge Base Question Answering☆11Mar 10, 2023Updated 3 years ago
- ☆12Apr 25, 2025Updated last year
- convert text to image☆12Aug 15, 2021Updated 5 years ago
- The implementation of Adaptive Computation function used in RNN "https://arxiv.org/pdf/1603.08983.pdf" and Universal Transformer Network …☆10Aug 30, 2018Updated 8 years ago
- [NeurIPS 2024] On the Worst Prompt Performance of LLMs☆11Nov 26, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 一个基于react16,react-router4,redux4的webapp。主要功能类似于朋友圈,动态编辑,图片上传,图片预览,点赞,评 论,用户登录注册,用户日志管理,用户信息管理。服务等是采用express ,数据持久化采用的是mongodb。功能相对来说比较简单,主…☆10Apr 15, 2021Updated 5 years ago
- Taiwanese Mandarin LLM Project☆19May 26, 2023Updated 3 years ago
- A magical AI playground designed to bring the power of Large Language Models (LLMs) directly to your device.☆14Aug 11, 2026Updated 2 months ago
- Demonstration of Skeleton visualization in RViz☆11Oct 21, 2022Updated 4 years ago
- Tools for speech recognition☆11Jun 24, 2017Updated 9 years ago
- Instant messaging with a neural network☆11Nov 13, 2016Updated 9 years ago
- Advanced audio player component (audix) for Streamlit with waveform visualization and region selection☆14Jun 24, 2025Updated last year
- Label Print Tool of Spirit☆17Aug 28, 2026Updated 2 months ago
- 最好用的滚动到顶部chrome插件☆13Aug 28, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Evaluation code for benchmarking VLMs in traditional chinese understanding☆18Dec 22, 2025Updated 10 months ago
- 图片分享app☆15Feb 17, 2019Updated 7 years ago
- TransDTI: Transformer-based language models for estimating DTIs and building a drug-recommendation workflow☆13Oct 26, 2022Updated 4 years ago
- An Efficent BPE Algorithm Faster then Hugging Face Tokenizer's Implementation☆13Sep 30, 2026Updated last month
- ☆18Feb 6, 2025Updated last year
- Fast code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆13Dec 5, 2024Updated last year
- 校园音乐征集投票系统 A system for electing annual school music☆10Oct 23, 2026Updated last week
- 《自己动手设计数据库》摘录☆10Oct 28, 2016Updated 10 years ago
- [ECCV'24] UNIT: Backdoor Mitigation via Automated Neural Distribution Tightening☆10Dec 18, 2025Updated 10 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A WAV encoding/decoding library for Go☆10May 25, 2019Updated 7 years ago
- KnowLA: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptation, NAACL 2024☆16Jul 29, 2024Updated 2 years ago
- Go package for getting docker container resource limit&usage metrics.☆11Apr 20, 2018Updated 8 years ago
- A distributed token-bucket rate limiter backed by Redis.☆19Jun 19, 2017Updated 9 years ago
- 量化交易网站,软工三大作业迭代三,团队项目☆11Mar 8, 2018Updated 8 years ago
- 基于Open-AI的chatgpt-3.5turbo和Whisper-1实现的语音交互辩论机器人,利用Gradio部署,体验网址如下☆10Sep 15, 2023Updated 3 years ago
- Taurix OS kernel. Taurix 系统内核,操作系统原理实(xjb)践(写)☆12Dec 20, 2020Updated 5 years ago
- 本数据集旨在通过微调大语言模型来提升用户的批判性思维和推理能力。数据集包括结构化的问答环节、角色扮演场景和辩论,旨在引导用户进行分析、评估和构建有逻辑的论证。该数据集鼓励深度思考和反思性学习,特别适用于教育、辅导以及技能开发等领域的应用☆14Sep 15, 2024Updated 2 years ago
- Reverse Polish Notation calculator for ESP8266 & ESP32 microcontrollers.☆11Feb 28, 2020Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 个人开发的敏捷开发平台☆10Jan 4, 2017Updated 9 years ago
- 使用BiLSTM+CRF进行邮寄地址识别任务的开发☆18Mar 8, 2022Updated 4 years ago
- OpenCV for Raspberry Pi 3☆18Apr 13, 2019Updated 7 years ago
- A Markov chain algorithm that generates junk text.☆16Mar 22, 2018Updated 8 years ago
- NewsApp包含客户端源码、服务端源码、数据库文件。 基于Miscrosoft人工智能项目ProjectOxford中的Recognition Emotion做的, 主要是基于用户的面部表 情来推送不同类别的新闻。 Emotion API可以参考:https://www.p…☆10Mar 2, 2016Updated 10 years ago
- This repository is about how to implement your Intel realsense camera for skeleton tracking in Linux system.☆11Oct 22, 2020Updated 6 years ago
- A power sql tools for jupyterlab☆21May 2, 2024Updated 2 years ago