An Efficent BPE Algorithm Faster then Hugging Face Tokenizer's Implementation
☆13Sep 30, 2026Updated last month
Alternatives and similar repositories for efficient_bpe
Users that are interested in efficient_bpe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 使用Sentencepiece对中文语料进行分词☆13Nov 30, 2023Updated 2 years ago
- replication of micro-price on crytocurrency data☆10Feb 27, 2022Updated 4 years ago
- 字节青训营项目,实现一个简易版的抖音☆14Nov 7, 2023Updated 2 years ago
- mahjong project @ pku RL course☆11Dec 31, 2022Updated 3 years ago
- An educational Chinese-to-English NMT project featuring the classic encoder-decoder Transformer and a configurable modern decoder-only GP…☆19Jun 7, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆13Jul 18, 2025Updated last year
- ☆16Oct 5, 2026Updated 3 weeks ago
- ☆14Dec 8, 2022Updated 3 years ago
- ☆11Jul 28, 2022Updated 4 years ago
- 一个强调工程化、可观测、可测试、可扩展的 RAG 项目。TraceRAG 的目标不是只把答案“生成出来”,而是把文档导入、切块、向量化、检索、带来源回答、评估与后续 tracing 拆成可独立验证的阶段,逐步演进成一个可维护、可解释、可复盘的生产级 RAG。☆15Apr 2, 2026Updated 7 months ago
- Training Coder Models with Critique Reinforcement Learning [ICLR26]☆13Apr 11, 2026Updated 6 months ago
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆18Mar 20, 2026Updated 7 months ago
- Unofficial Elixir SDK for OpenCode☆15Oct 16, 2026Updated 2 weeks ago
- ☆18Feb 6, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- The UnisonAI Multi-Agent Framework built on custom workflow which allows ai agents to talk together and provides a flexible and extensibl…☆23Feb 24, 2026Updated 8 months ago
- Fast code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆13Dec 5, 2024Updated last year
- 校园音乐征集投票系统 A system for electing annual school music☆10Oct 23, 2026Updated last week
- [ECCV'24] UNIT: Backdoor Mitigation via Automated Neural Distribution Tightening☆10Dec 18, 2025Updated 10 months ago
- T2J-Bench: A benchmark testing whether coding agents can migrate real PyTorch training and inference repositories to native JAX/Flax.☆13Oct 23, 2026Updated last week
- I love reinforcement learning.☆17Jan 15, 2025Updated last year
- 量化交易网站,软工三大作业迭代三,团队项目☆11Mar 8, 2018Updated 8 years ago
- 基于Open-AI的chatgpt-3.5turbo和Whisper-1实现的语音交互辩论机器人,利用Gradio部署,体验网址如下☆10Sep 15, 2023Updated 3 years ago
- Taurix OS kernel. Taurix 系统内核,操作系统原理实(xjb)践(写)☆12Dec 20, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- An attempt to understand automated AI research☆24Aug 15, 2026Updated 2 months ago
- 本数据集旨在通过微调大语言模型来提升用户的批判性思维和推理能力。数据集包括结构化的问答环节、角色扮演场景和辩论,旨在引导用户进行分析、评估和构建有逻辑的论证。该数据集鼓励深度思考和反思性学习,特别适用于教育、辅导以及技能开发等领域的应用☆14Sep 15, 2024Updated 2 years ago
- 个人开发的敏捷开发平台☆10Jan 4, 2017Updated 9 years ago
- ☆26Jun 27, 2025Updated last year
- NewsApp包含客户端源码、服务端源码、数据库文件。 基于Miscrosoft人工智能项目ProjectOxford中的Recognition Emotion做的, 主要是基于用户的面部表情来推送不同类别的新闻。 Emotion API可以参考:https://www.p…☆10Mar 2, 2016Updated 10 years ago
- Implementation of my CS336 assignment1☆52Dec 23, 2025Updated 10 months ago
- 本系统实现了以Kinect骨骼识别为基础的人机协同运动,模拟平行空间实现远程协同。 Kinect方面的 开发重点在于“人机协同”。结合Kinect体感控制技术与机器人控制技术,通过Kinect体感传感器采集人体动作信息,在电脑上进行图像处理,解析出相应的人体动作,然后建立so…☆10Dec 23, 2024Updated last year
- ☆24Nov 4, 2024Updated last year
- 这是一个可通过网页远程登录管理、可接入讯飞星火、ChatGPT等大语言模型的微信聊天机器人,使用微信网页版协议。☆16Feb 20, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 基于MFCC特征构建单核GMM的0-9独立词语音识别,MFCC,GMM,sklearn,Isolated word recognition。☆10Nov 18, 2020Updated 5 years ago
- Python environment for Chinese Standard Mahjong on Botzone platform.☆19Jan 18, 2021Updated 5 years ago
- ☆12Dec 18, 2024Updated last year
- 自动将GitHub用户批量渲染生成为README中的用户名&&头像墙 | Automatic batch rendering of GitHub users into usernames && avatar wall in README☆17Jun 17, 2022Updated 4 years ago
- ☆15Jan 6, 2025Updated last year
- 手势识别玩俄罗斯方块小游戏☆12Jul 20, 2021Updated 5 years ago
- The official codebase for NLPDL 2025Fall for Peking University☆17Dec 22, 2025Updated 10 months ago