Alternatives and similar repositories for token_visualizer:

Users that are interested in token_visualizer are comparing it to the libraries listed below

• FlagOpen / Infinity-Instruct
  ☆45Updated 8 months ago
• GAIR-NLP / ReAlign
  Reformatted Alignment
  ☆114Updated 4 months ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆128Updated 8 months ago
• GAIR-NLP / ProX
  Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"
  ☆217Updated this week
• cavalierlulu / rag_survey
  ☆121Updated last year
• open-compass / CompassJudger
  ☆79Updated 2 months ago
• zexuanqiu / CLongEval
  CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models
  ☆38Updated 11 months ago
• THUDM / LongAlign
  [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs
  ☆241Updated 2 months ago
• shuyhere / about-super-alignment
  Feeling confused about super alignment? Here is a reading list
  ☆42Updated last year
• SkyworkAI / skywork-o1-prm-inference
  ☆57Updated 2 months ago
• Zheng0428 / COIG-Kun
  ☆36Updated 5 months ago
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆233Updated 3 months ago
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆70Updated last year
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆157Updated 8 months ago
• OpenMOSS / HalluQA
  Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"
  ☆118Updated 8 months ago
• thu-coai / CritiqueLLM
  ☆139Updated 7 months ago
• bigai-nlco / LooGLE
  ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models
  ☆175Updated 4 months ago
• MLGroup-JLU / LLM-data-aug-survey
  The official GitHub page for the survey paper "A Survey on Data Augmentation in Large Model Era"
  ☆119Updated 7 months ago
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆28Updated 8 months ago
• AlphaPav / mem-kk-logic
  On Memorization of Large Language Models in Logical Reasoning
  ☆39Updated 3 months ago
• nishiwen1214 / Benchmark-leakage-detection
  Official completion of “Training on the Benchmark Is Not All You Need”.
  ☆29Updated last month
• OpenStellarTeam / ChineseSimpleQA
  ☆51Updated 3 weeks ago
• multimodal-art-projection / Megatron-LM-NEO
  ☆36Updated 9 months ago
• dvlab-research / Q-LLM
  This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"
  ☆45Updated 7 months ago
• crazycth / WizardLearner
  Pretrain、decay、SFT a CodeLLM from scratch 🧙‍♂️
  ☆36Updated 9 months ago
• OpenBMB / RAGEval
  ☆125Updated 2 weeks ago
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆88Updated last month
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆65Updated 2 months ago