Alternatives and similar repositories for OpenLLMDE:

Users that are interested in OpenLLMDE are comparing it to the libraries listed below

• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆56Updated 11 months ago
• Academic-Hammer / HammerLLM
  1.4B sLLM for Chinese and English - HammerLLM🔨
  ☆44Updated 11 months ago
• princeton-pli / MeCo
  Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"
  ☆36Updated last week
• Zheng0428 / COIG-Kun
  ☆36Updated 6 months ago
• dqwang122 / MLROUGE
  ROUGE for multilingual Summarization
  ☆23Updated 3 years ago
• WalkerMitty / Fast-Llama2
  Fast instruction tuning with Llama2
  ☆11Updated 11 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆45Updated 3 months ago
• Alibaba-NLP / RankingGPT
  code for paper 《RankingGPT: Empowering Large Language Models in Text Ranking with Progressive Enhancement》
  ☆31Updated last year
• FlagOpen / Infinity-Instruct
  ☆45Updated 9 months ago
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆72Updated last year
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆36Updated last year
• onesuper / HuggingFace-Datasets-Text-Quality-Analysis
  Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…
  ☆53Updated last year
• seanzhang-zhichen / baichuan-Dynamic-NTK-ALiBi
  百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本
  ☆47Updated last year
• ssbuild / aigc_evals
  aigc evals
  ☆10Updated last year
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆30Updated 10 months ago
• OpenBMB / DecT
  Source code for ACL 2023 paper Decoder Tuning: Efficient Language Understanding as Decoding
  ☆48Updated last year
• TianHongZXY / CoRe
  [ACL 2023] Solving Math Word Problems via Cooperative Reasoning induced Language Models (LLMs + MCTS + Self-Improvement)
  ☆48Updated last year
• RWKV-Wiki / MultilingualShareGPT
  MultilingualShareGPT, the free multi-language corpus for LLM training
  ☆73Updated last year
• yhao-wang / LLM-Knowledge-Boundary
  Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"
  ☆22Updated last year
• QwenLM / online_merging_optimizers
  Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment
  ☆74Updated 9 months ago
• beichao1314 / Open-Llama
  The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.
  ☆65Updated 2 years ago
• thu-coai / SPaR
  ☆44Updated 3 months ago
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆62Updated last year
• lifan-yuan / CRAFT
  Code for ICLR 2024 paper "CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets"
  ☆52Updated 9 months ago
• LydiaXiaohongLi / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆19Updated last year
• MadeAgents / Hammer
  Hammer: Robust Function-Calling for On-Device Language Models via Function Masking
  ☆63Updated last month
• wangrui6 / Zhihu-KOL
  ☆31Updated last year
• shuyhere / all-about-llm
  大语言模型训练和服务调研
  ☆37Updated last year
• fairyshine / Seal-Tools
  The source code and dataset mentioned in the paper Seal-Tools: Self-Instruct Tool Learning Dataset for Agent Tuning and Detailed Benchmar…
  ☆45Updated 4 months ago
• THUDM / NaturalCodeBench
  NaturalCodeBench (Findings of ACL 2024)
  ☆62Updated 5 months ago