Fast code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
☆13Dec 5, 2024Updated last year
Alternatives and similar repositories for QuickBPE
Users that are interested in QuickBPE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Trans…☆12Oct 13, 2026Updated last week
- Conversational AI services☆18Aug 17, 2023Updated 3 years ago
- LLM inference in C/C++☆35Updated this week
- CPU-only toy text watermark experiment comparing synonym edits, German and Chinese round-trips, and paraphrasing☆18Sep 9, 2026Updated last month
- An Efficent BPE Algorithm Faster then Hugging Face Tokenizer's Implementation☆13Sep 30, 2026Updated 3 weeks ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A rules induction system for data mining and exploratory data analysis☆12Jul 17, 2024Updated 2 years ago
- ☆23Dec 3, 2022Updated 3 years ago
- Welcome to the LLM Tutorials and RAG Implementations repository! This repository provides tutorials, guides, and implementations for work…☆13Jul 1, 2025Updated last year
- Full featured web server for TOR Hidden Services with Vanguards, NGINX, PHP-FPM, MariaDB, NYX, Supervisor and dnsmasq. One Container for …☆13Aug 12, 2022Updated 4 years ago
- This repository contains code for the paper "Learning Decision Trees as Amortized Structure Inference"☆17Mar 25, 2025Updated last year
- Self Organizing Maps (SOM) ML model can be used to conduct semantic search to populate context required for Retrieval Augmented Generatio…☆15Mar 16, 2024Updated 2 years ago
- ☆10Nov 24, 2024Updated last year
- Repository sifter and hardlinker☆13Jun 13, 2020Updated 6 years ago
- ☆38Oct 14, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Simple Moving Average system backtest☆11May 8, 2021Updated 5 years ago
- An embeddable widget for interacting with openAI api compatable LLM's☆17Sep 18, 2024Updated 2 years ago
- ☆18Feb 6, 2025Updated last year
- 校园音乐征集投票系统 A system for electing annual school music☆10Oct 3, 2026Updated 2 weeks ago
- ☆12Feb 7, 2024Updated 2 years ago
- ☆13Feb 3, 2025Updated last year
- open-high-low-close types and tools☆35Oct 13, 2023Updated 3 years ago
- [ECCV'24] UNIT: Backdoor Mitigation via Automated Neural Distribution Tightening☆10Dec 18, 2025Updated 10 months ago
- 本数据集旨在通过微调大语言模型来提升用户的批判性思维和推理能力。数据集包括结构化的问答环节、角色扮演场景和辩论，旨在引导用户进行分析、评估和构建有逻辑的论证。该数据集鼓励深度思考和反思性学习，特别适用于教育、辅导以及技能开发等领域的应用☆14Sep 15, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- CSSegmentation: An Open Source Continual Semantic Segmentation Toolbox Based on PyTorch.☆38Feb 6, 2024Updated 2 years ago
- A proof-of-concept parser for the Prolog programming language, at the Bern University of Applied Sciences for the course "Automata and fo…☆11Jan 17, 2014Updated 12 years ago
- Intuitive RAG system on top of LllamaIndex☆15Nov 8, 2024Updated last year
- TH4J- A wrapper of torch TH library for Java (JVM langauges).☆11Nov 4, 2015Updated 10 years ago
- Documentation of the Snap Camera / Snapchat lens .lns file format.☆12Feb 1, 2025Updated last year
- 量化交易网站，软工三大作业迭代三，团队项目☆11Mar 8, 2018Updated 8 years ago
- Taurix OS kernel. Taurix 系统内核，操作系统原理实(xjb)践(写)☆12Dec 20, 2020Updated 5 years ago
- NewsApp包含客户端源码、服务端源码、数据库文件。 基于Miscrosoft人工智能项目ProjectOxford中的Recognition Emotion做的， 主要是基于用户的面部表情来推送不同类别的新闻。 Emotion API可以参考：https://www.p…☆10Mar 2, 2016Updated 10 years ago
- Multithreaded TCP Client/Server implementation in C++☆12Jul 20, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 使用Sentencepiece对中文语料进行分词☆13Nov 30, 2023Updated 2 years ago
- 本系统实现了以Kinect骨骼识别为基础的人机协同运动，模拟平行空间实现远程协同。 Kinect方面的开发重点在于“人机协同”。结合Kinect体感控制技术与机器人控制技术，通过Kinect体感传感器采集人体动作信息，在电脑上进行图像处理，解析出相应的人体动作，然后建立so…☆10Dec 23, 2024Updated last year
- ☆12Dec 18, 2024Updated last year
- TFN layers built using Tensorflow 2☆15Jul 15, 2021Updated 5 years ago
- A fork of LatinIME (by Google for Android), targeting marginalised languages that also deserve first-class status on mobile operating sys…☆14Aug 27, 2026Updated last month
- Helpers for setting up an embedded Python interpreter☆20Oct 31, 2025Updated 11 months ago
- 这是一个可通过网页远程登录管理、可接入讯飞星火、ChatGPT等大语言模型的微信聊天机器人，使用微信网页版协议。☆16Feb 20, 2024Updated 2 years ago