Alternatives and similar repositories for HuggingFace-Datasets-Text-Quality-Analysis

Users that are interested in HuggingFace-Datasets-Text-Quality-Analysis are comparing it to the libraries listed below

• RWKV-Wiki / MultilingualShareGPT
  MultilingualShareGPT, the free multi-language corpus for LLM training
  ☆72Updated 2 years ago
• OpenLMLab / ChatZoo
  Light local website for displaying performances from different chat models.
  ☆87Updated last year
• icip-cas / ChatAlpaca
  A Multi-Turn Dialogue Corpus based on Alpaca Instructions
  ☆171Updated 2 years ago
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆91Updated last year
• Academic-Hammer / HammerLLM
  1.4B sLLM for Chinese and English - HammerLLM🔨
  ☆44Updated last year
• AIR-Bench / AIR-Bench
  AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆142Updated 5 months ago
• aplmikex / deduplication_mnbvc
  文本去重
  ☆72Updated last year
• Longyichen / Alpaca-family-library
  Summarize all open source Large Languages Models and low-cost replication methods for Chatgpt.
  ☆137Updated 2 years ago
• zexuanqiu / CLongEval
  CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models
  ☆40Updated last year
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Updated last year
• BAAI-Zlab / COIG
  ☆128Updated 2 years ago
• llm-factory / imitater
  Imitate OpenAI with Local Models
  ☆87Updated 9 months ago
• llmeval / llmeval-2
  中文大语言模型评测第二期
  ☆70Updated last year
• FlagOpen / FlagInstruct
  ☆172Updated 2 years ago
• ExpressAI / AI-Gaokao
  Gaokao Benchmark for AI
  ☆108Updated 2 years ago
• THU-KEG / ChatLog
  ⏳ ChatLog: Recording and Analysing ChatGPT Across Time
  ☆99Updated last year
• LaVi-Lab / CLEVA
  [EMNLP 2023 Demo] "CLEVA: Chinese Language Models EVAluation Platform" [ACL 2025 Findings] "C2LEVA: Toward Comprehensive and Contaminatio…
  ☆63Updated 3 weeks ago
• Spico197 / Humpback
  🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.
  ☆140Updated last month
• AI21Labs / Parallel-Context-Windows
  ☆105Updated last year
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆220Updated last year
• basicv8vc / chinese-instruction-datasets-for-llms
  用于微调LLM的中文指令数据集
  ☆26Updated 2 years ago
• raunak-agarwal / instruction-datasets
  All available datasets for Instruction Tuning of Large Language Models
  ☆250Updated last year
• Felixgithub2017 / MMCU
  MEASURING MASSIVE MULTITASK CHINESE UNDERSTANDING
  ☆87Updated last year
• thu-coai / CritiqueLLM
  ☆142Updated 11 months ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆37Updated last year
• multimodal-art-projection / Megatron-LM-NEO
  ☆40Updated last year
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆313Updated 2 years ago
• codefuse-ai / D2LLM
  ☆30Updated 10 months ago
• beichao1314 / Open-Llama
  The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.
  ☆65Updated 2 years ago
• FreedomIntelligence / GPT-API-Accelerate
  The "GPT-API-Accelerate" project provides a set of Python classes for accelerating the process of generating responses to prompts using t…
  ☆23Updated 7 months ago