FateScript / token_visualizerLinks
Token level visualization tools for large language models
☆82Updated 5 months ago
Alternatives and similar repositories for token_visualizer
Users that are interested in token_visualizer are comparing it to the libraries listed below
Sorting:
- [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.☆244Updated 8 months ago
- Official github repo for AutoDetect, an automated weakness detection framework for LLMs.☆42Updated last year
- Reformatted Alignment☆113Updated 9 months ago
- Feeling confused about super alignment? Here is a reading list☆43Updated last year
- ☆142Updated 11 months ago
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆251Updated 3 weeks ago
- On Memorization of Large Language Models in Logical Reasoning☆67Updated 3 months ago
- ☆67Updated 5 months ago
- Fantastic Data Engineering for Large Language Models☆89Updated 6 months ago
- [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)☆149Updated 4 months ago
- We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.☆57Updated 8 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆160Updated this week
- ☆36Updated 9 months ago
- A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…☆47Updated 2 weeks ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆133Updated last year
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆101Updated last month
- Official completion of “Training on the Benchmark Is Not All You Need”.☆34Updated 6 months ago
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆116Updated 2 months ago
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆68Updated last month
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆30Updated last month
- ☆63Updated 7 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆176Updated last year
- ☆95Updated 6 months ago
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆40Updated last year
- code for Scaling Laws of RoPE-based Extrapolation☆73Updated last year
- ☆152Updated last month
- The All-in-one Judge Models introduced by Opencompass☆93Updated 4 months ago
- Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning☆188Updated 3 months ago
- The official repository of the Omni-MATH benchmark.☆84Updated 6 months ago
- [ACL-25] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆63Updated 8 months ago