FateScript / token_visualizerLinks
Token level visualization tools for large language models
☆81Updated 5 months ago
Alternatives and similar repositories for token_visualizer
Users that are interested in token_visualizer are comparing it to the libraries listed below
Sorting:
- Feeling confused about super alignment? Here is a reading list☆42Updated last year
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆106Updated last month
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆132Updated 11 months ago
- ☆49Updated last month
- Official completion of “Training on the Benchmark Is Not All You Need”.☆32Updated 5 months ago
- Official github repo for AutoDetect, an automated weakness detection framework for LLMs.☆42Updated 11 months ago
- Pretrain、decay、SFT a CodeLLM from scratch 🧙♂️☆35Updated last year
- Reformatted Alignment☆114Updated 8 months ago
- ☆49Updated last year
- We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.☆55Updated 8 months ago
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆27Updated last week
- Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"☆128Updated last year
- [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)☆141Updated 3 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆157Updated 9 months ago
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆248Updated 3 weeks ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆175Updated 11 months ago
- ☆36Updated 9 months ago
- ☆105Updated last year
- ☆142Updated 11 months ago
- A Comprehensive Survey on Long Context Language Modeling☆147Updated this week
- Reproducing R1 for Code with Reliable Rewards☆208Updated last month
- ☆47Updated 11 months ago
- [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.☆243Updated 7 months ago
- code for Scaling Laws of RoPE-based Extrapolation☆73Updated last year
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆40Updated last year
- Self-Evolved Diverse Data Sampling for Efficient Instruction Tuning☆80Updated last year
- On Memorization of Large Language Models in Logical Reasoning☆65Updated 2 months ago
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆110Updated this week
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆68Updated 3 weeks ago
- This repository collects research papers on learning from rewards in the context of post-training and test-time scaling of large language…☆37Updated 3 weeks ago