Alternatives and similar repositories for Fast-Llama2

Users that are interested in Fast-Llama2 are comparing it to the libraries listed below

• yongzhuo / qwen2-sft
  Qwen1.5-SFT(阿里, Ali), Qwen_Qwen1.5-2B-Chat/Qwen_Qwen1.5-7B-Chat微调(transformers)/LORA(peft)/推理
  ☆63Updated last year
• Academic-Hammer / HammerLLM
  1.4B sLLM for Chinese and English - HammerLLM🔨
  ☆44Updated last year
• beichao1314 / Open-Llama
  The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.
  ☆66Updated 2 years ago
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆58Updated last year
• shuyhere / all-about-llm
  大语言模型训练和服务调研
  ☆37Updated last year
• ArtificialZeng / transformers-Explained
  官方transformers源码解析。AI大模型时代，pytorch、transformer是新操作系统，其他都是运行在其上面的软件。
  ☆17Updated last year
• XiaoMi / subllm
  This repository is the official implementation of the ECAI 2024 conference paper SUBLLM: A Novel Efficient Architecture with Token Sequen…
  ☆69Updated 11 months ago
• StarRing2022 / R1-Nature
  最简易的R1结果在小模型上的复现，阐述类O1与DeepSeek R1最重要的本质。Think is all your need。利用实验佐证，对于强推理能力，think思考过程性内容是AGI/ASI的核心。
  ☆45Updated 5 months ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆40Updated last year
• RUC-GSAI / Yulan-GARDEN
  Official Repository for SIGIR2024 Demo Paper "An Integrated Data Processing Framework for Pretraining Foundation Models"
  ☆81Updated 10 months ago
• ArtificialZeng / llama3_explained
  the newest version of llama3，source code explained line by line using Chinese
  ☆22Updated last year
• Longyichen / Alpaca-family-library
  Summarize all open source Large Languages Models and low-cost replication methods for Chatgpt.
  ☆137Updated 2 years ago
• heyblackC / BetterMixture-Top1-Solution
  天池算法比赛《BetterMixture - 大模型数据混合挑战赛》的第一名top1解决方案
  ☆31Updated last year
• OpenLLMAI / OpenLLMDE
  OpenLLMDE: An open source data engineering framework for LLMs
  ☆17Updated last year
• InternLM / Condor
  [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement
  ☆31Updated last month
• 5663015 / LLMs_train
  一套代码指令微调大模型
  ☆39Updated last year
• alibaba-damo-academy / SpokenNLP
  A wide variety of research projects developed by the SpokenNLP team of Speech Lab, Alibaba Group.
  ☆116Updated last month
• cjymz886 / LLM-RAG-QA
  LLM+RAG for QA
  ☆22Updated last year
• ssbuild / llm_finetuning
  Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on
  ☆97Updated last year
• MikeGu721 / EasyLLM
  make LLM easier to use
  ☆59Updated 2 years ago
• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆151Updated 2 years ago
• WALLE-AI / uReasoningLLMs
  Deepseek-r1复现科普与资源汇总
  ☆21Updated 4 months ago
• NEU-DataMining / PICA
  多轮共情对话模型PICA
  ☆95Updated last year
• tianchiguaixia / ocr_recognition
  微调阿里开源的文字检测模型，利用合合识别返回的OCR结果作为初始训练数据，对模型进行优化训练，使其更加适应1万张图片的具体场景，提高文字识别的精度。
  ☆9Updated 7 months ago
• seanzhang-zhichen / Qwen-WisdomVast
  Qwen-WisdomVast is a large model trained on 1 million high-quality Chinese multi-turn SFT data, 200,000 English multi-turn SFT data, and …
  ☆18Updated last year
• GuoYiFantastic / IMelodist
  Music large model based on InternLM2-chat.
  ☆22Updated 6 months ago
• FlagOpen / Infinity-Instruct
  ☆48Updated last year
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆33Updated last year
• xyjigsaw / LLM-Pretrain-SFT
  Scripts of LLM pre-training and fine-tuning (w/wo LoRA, DeepSpeed)
  ☆82Updated last year
• llm-factory / imitater
  Imitate OpenAI with Local Models
  ☆87Updated 10 months ago