Vocabulary list of GPT-4o (o200k_base) and GPT-4/GPT-3.5 (cl100k_base) tokenizers. Special tokens are excluded.
☆73May 14, 2024Updated 2 years ago
Alternatives and similar repositories for gpt4_vocab_list
Users that are interested in gpt4_vocab_list are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code repo of our paper Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis (https://arxiv.org/abs/2406.10794…☆24Jul 26, 2024Updated 2 years ago
- ☆10Jul 31, 2026Updated 2 months ago
- A tool to calculate dataset scaling needed to achieve cross-lingual training data equity.☆13Aug 14, 2024Updated 2 years ago
- From Easy to Hard: A Dual Curriculum Learning Framework for Context-Aware Document Ranking☆14Oct 25, 2022Updated 4 years ago
- ☆15Aug 2, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Fine-tuning large language models (LLMs) is crucial for enhancing performance across domain-specific task applications. This comprehensiv…☆13Sep 19, 2024Updated 2 years ago
- [EMNLP'2024 Findings] Explore generated documents for enhanced IR with LLMs. We enhance BM25 to surpass strong dense retriever on many da…☆14Mar 28, 2025Updated last year
- SIMPLE: A Gradient Estimator for $k$-subset Sampling☆11Aug 8, 2024Updated 2 years ago
- A Review of Deep-Learning-based Singing Voice Synthesis Approaches☆13Oct 3, 2026Updated 3 weeks ago
- ☆17Jun 20, 2023Updated 3 years ago
- A σ-VAE implementation in TensorFLow☆16Mar 24, 2023Updated 3 years ago
- DQN based RL agent for Mountain Car☆12Sep 7, 2016Updated 10 years ago
- Adversarial Attack for Pre-trained Code Models☆10Jul 19, 2022Updated 4 years ago
- Electron版の空間アプリ☆10Dec 17, 2021Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆30Aug 12, 2026Updated 2 months ago
- ☆21Nov 4, 2025Updated 11 months ago
- Code for Personalized Large Language Models via Selective Prompt Tuning☆10Jun 26, 2024Updated 2 years ago
- Chrome Extension. As the name suggests.☆10Jan 30, 2022Updated 4 years ago
- Highly concurrent and fast content processing for Mighty Inference Server☆10Feb 6, 2023Updated 3 years ago
- ☆29Feb 1, 2023Updated 3 years ago
- ☆15Aug 7, 2025Updated last year
- Lexical semantic change detection shared task at SemEval 2020: UiO-UVA team☆16Jan 10, 2023Updated 3 years ago
- Evaluation Pipeline for medical tasks.☆11Apr 8, 2026Updated 6 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆13Jan 9, 2022Updated 4 years ago
- ☆11Aug 19, 2026Updated 2 months ago
- Source codes and datasets for How well do Large Language Models perform in Arithmetic tasks?☆57Apr 17, 2023Updated 3 years ago
- ☆10Jul 28, 2020Updated 6 years ago
- 📃CSS Parser for R [Concept]☆12Aug 10, 2019Updated 7 years ago
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks☆17Apr 24, 2024Updated 2 years ago
- Auto rename pasted images added to the vault via hash algorithm SHA-512☆11Aug 25, 2025Updated last year
- [EMNLP 2025] Reasoning-to-Defend: Safety-Aware Reasoning Can Defend Large Language Models from Jailbreaking☆12Aug 22, 2025Updated last year
- Toggle bluetooth paired device connectivity☆12Jan 17, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official implementation of "Breaking the Factorization Barrier in Diffusion Language Models"☆19Mar 27, 2026Updated 7 months ago
- A repository of OpenDecoder framework: Open Large Language Model Decoding to Incorporate Document Quality in RAG (WWW 2026)☆27Jan 27, 2026Updated 9 months ago
- bevy_openai is an event-driven plugin for Bevy that provides convenient access to the OpenAI API.☆12Jan 28, 2024Updated 2 years ago
- The evaluation code for the paper "MoreHopQA: More Than Multi-hop Reasoning"☆16Jun 21, 2024Updated 2 years ago
- This repository provides the dataset used in "Schema-Guided Natural Language Generation" by Yuheng Du, Shereen Oraby, Vittorio Perera, Mi…☆13Dec 8, 2020Updated 5 years ago
- Published version of @shadcn/ui☆10Mar 18, 2024Updated 2 years ago
- Code for "Prediction-Powered Ranking of Large Language Models", NeurIPS 2024.☆10Oct 28, 2024Updated 2 years ago