Vocabulary list of GPT-4o (o200k_base) and GPT-4/GPT-3.5 (cl100k_base) tokenizers. Special tokens are excluded.
☆70May 14, 2024Updated 2 years ago
Alternatives and similar repositories for gpt4_vocab_list
Users that are interested in gpt4_vocab_list are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code repo of our paper Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis (https://arxiv.org/abs/2406.10794…☆24Jul 26, 2024Updated last year
- ☆15Aug 2, 2024Updated last year
- 日本語マルチタスク言 語理解ベンチマーク Japanese Massive Multitask Language Understanding Benchmark☆40Oct 7, 2025Updated 9 months ago
- ☆19Nov 4, 2025Updated 8 months ago
- ☆22Jan 11, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Trained a 114 million Parameter LLM from Scratch.☆19Jul 21, 2024Updated 2 years ago
- GA algorithm to solve bin packing and production scheduling problems☆15Sep 11, 2022Updated 3 years ago
- ☆30Mar 20, 2024Updated 2 years ago
- Highly concurrent and fast content processing for Mighty Inference Server☆10Feb 6, 2023Updated 3 years ago
- Evaluation Pipeline for medical tasks.☆12Apr 8, 2026Updated 3 months ago
- Make a GitHub Action implemented in Rust☆14Updated this week
- A simple library to better manage AI prompts in your Rust code.☆14Apr 29, 2024Updated 2 years ago
- ☆13Jan 9, 2022Updated 4 years ago
- ☆11Oct 2, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 📃CSS Parser for R [Concept]☆12Aug 10, 2019Updated 6 years ago
- ☆10Dec 18, 2023Updated 2 years ago
- Source codes and datasets for How well do Large Language Models perform in Arithmetic tasks?☆57Apr 17, 2023Updated 3 years ago
- [EMNLP 2025] Reasoning-to-Defend: Safety-Aware Reasoning Can Defend Large Language Models from Jailbreaking☆12Aug 22, 2025Updated 10 months ago
- ☆12Nov 25, 2024Updated last year
- ☆23May 27, 2020Updated 6 years ago
- yet another anki app☆14Sep 9, 2024Updated last year
- [ACL 2024] CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completion☆61Oct 1, 2025Updated 9 months ago
- The evaluation code for the paper "MoreHopQA: More Than Multi-hop Reasoning"☆15Jun 21, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- bevy_openai is an event-driven plugin for Bevy that provides convenient access to the OpenAI API.☆12Jan 28, 2024Updated 2 years ago
- Implementation of "RaanA: A Fast, Flexible, and Data-Efficient Post-Training Quantization Algorithm"☆17Apr 11, 2025Updated last year
- Strip HTML Tags☆17Nov 18, 2015Updated 10 years ago
- Published version of @shadcn/ui☆10Mar 18, 2024Updated 2 years ago
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks☆17Apr 24, 2024Updated 2 years ago
- Chinese Natural Language Correction via Language Model☆15Sep 14, 2017Updated 8 years ago
- ☆14May 21, 2024Updated 2 years ago
- Pandas Helper Library for reading and writing DataFrames from and to HBase.☆10Mar 8, 2018Updated 8 years ago
- Welcome to the official repository for Siren, a project aimed at understanding and mitigating harmful behaviors in large language models …☆15Jun 14, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Excel/CSV to LaTeX Table☆19Jan 12, 2020Updated 6 years ago
- Official Code for Efficient and Effective Augmentation Strategy for Adversarial Training (NeurIPS-2022)☆17Mar 29, 2023Updated 3 years ago
- 📦 A set of bash scripts that package and unpack your codebase into and from a single JSON file, ready to be analyzed and understood by l…☆12Nov 10, 2024Updated last year
- Simple implementation of a GPT (training and inference) in PyTorch.☆13Dec 11, 2023Updated 2 years ago
- Official repository for the paper "Gradient-based Jailbreak Images for Multimodal Fusion Models" (https//arxiv.org/abs/2410.03489)☆20Oct 22, 2024Updated last year
- Conversion script adapting vicuna dataset into alpaca format for use with oobabooga's trainer☆12Jun 21, 2023Updated 3 years ago
- Ansible for building kaggle environment☆13Jul 30, 2019Updated 6 years ago