fast bpe tokenizer, simple to understand, easy to use
☆28Jun 12, 2023Updated 3 years ago
Alternatives and similar repositories for fast_bpe_tokenizer
Users that are interested in fast_bpe_tokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- We introduce FixEval , a dataset for competitive programming bug fixing along with a comprehensive test suite and show the necessity of e…☆26Aug 31, 2022Updated 4 years ago
- Trials of pre-trained BERT models for the medical domain in Japanese.☆13Nov 21, 2020Updated 5 years ago
- ☆11Nov 19, 2022Updated 3 years ago
- 最新LLMの一覧を作成します☆23Aug 16, 2026Updated 2 weeks ago
- ☆12Jan 4, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repository contains the source code and links to some datasets used in the CoNLL 2019 paper "Learning to Represent Bilingual Diction…☆12Oct 1, 2020Updated 5 years ago
- 日本語マルチタスク言語理解ベンチマーク Japanese Massive Multitask Language Understanding Benchmark☆41Oct 7, 2025Updated 10 months ago
- ☆15Mar 12, 2024Updated 2 years ago
- Explore, Establish, Exploit: Red Teaming Language Models from Scratch☆15Jun 21, 2023Updated 3 years ago
- Overcooked-AI Experiment Psiturk Demo (for MTurk experiments)☆13May 10, 2021Updated 5 years ago
- ☆10Jul 22, 2021Updated 5 years ago
- Setu is a comprehensive pipeline designed to clean, filter, and deduplicate diverse data sources including Web, PDF, and Speech data. Bui…☆16May 17, 2024Updated 2 years ago
- fastNLP reimplementation of the paper "A Novel Cascade Binary Tagging Framework for Relational Triple Extraction"☆11Dec 11, 2020Updated 5 years ago
- Convert pdf to pages of images☆13Apr 18, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for CVPR2021 Paper “Cascaded Prediction Network via Segment Tree for Temporal Video Grounding”☆10Apr 3, 2022Updated 4 years ago
- Code for the paper Dynamics Generalisation in Reinforcement Learning via Adaptive Context-Aware Policies (NeurIPS 2023). https://arxiv.or…☆15Nov 21, 2023Updated 2 years ago
- [ACL'25] Official code of curiosity-driven RLHF☆16Jun 22, 2025Updated last year
- 《算法竞赛进阶指南》（Algorithm Competition Advanced Guide）中例题和习题的练习代码☆17Sep 24, 2018Updated 7 years ago
- ☆14Nov 25, 2025Updated 9 months ago
- This is a APRS project for DDP course☆10Apr 1, 2018Updated 8 years ago
- Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI☆56Jul 6, 2026Updated last month
- BTSync Ver.1.4.111, the last one with DHT.☆13Sep 3, 2019Updated 7 years ago
- 本科毕业论文、源码及相关材料☆15Dec 30, 2019Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A pytorch implementation of our paper Image Captioning with Inherent Sentiment (ICME 2021 Oral).☆11Jul 18, 2022Updated 4 years ago
- JSON Schema format for storing datasets details, documents processed contents, and documents annotations in the document understanding do…☆14Nov 5, 2024Updated last year
- ☆26Jan 20, 2025Updated last year
- ☆12Sep 8, 2024Updated last year
- 不到100行代码实现一个Python迷你内网穿透、反向正向代理小工具☆12May 27, 2023Updated 3 years ago
- code for Preprint paper at Arxiv: MoT: Pre-thinking and Recalling Enable ChatGPT to Self-Improve with Memory-of-Thoughts☆24Nov 29, 2023Updated 2 years ago
- Official PyTorch implementation for "Towards Lightweight Controllable Audio Synthesis with Conditional Implicit Neural Representations".☆21Dec 3, 2021Updated 4 years ago
- Open-source repository for the OOPSLA'24 paper "CYCLE: Learning to Self-Refine Code Generation"☆10Mar 8, 2024Updated 2 years ago
- ☆15Nov 28, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Slack Socket Mode broker that routes Slack threads into Codex app-server sessions with isolated workspaces.☆16Aug 26, 2026Updated last week
- The Latex template for BNU thesis, revised based on http://gerry.lamost.org/blog/?p=811☆10Mar 13, 2019Updated 7 years ago
- 22人で童謡を5曲ずつ歌ってつくった歌唱データベースです。☆15Aug 7, 2022Updated 4 years ago
- [QReward] RewardService Python Client, make RL Training reward function more faster☆16Apr 23, 2026Updated 4 months ago
- Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions☆21Apr 15, 2022Updated 4 years ago
- Collections of RLxLM experiments using minimal codes☆14Feb 17, 2025Updated last year
- This is the code for the EMNLP2020 Finding paper "BERT for Monolingual and Cross-Lingual Reverse Dictionary"☆19Sep 27, 2020Updated 5 years ago