Alternatives and similar repositories for learn-deep-learning

Users that are interested in learn-deep-learning are comparing it to the libraries listed below

• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆58Updated last year
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆98Updated 2 years ago
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆79Updated 11 months ago
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆160Updated last year
• Rooooyy / HILL
  Official implementation for NAACL 2024 paper "HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Class…
  ☆19Updated last year
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆128Updated last year
• nuaa-nlp / paper-reading
  ☆45Updated 2 months ago
• shuyhere / about-super-alignment
  Feeling confused about super alignment? Here is a reading list
  ☆44Updated 2 years ago
• dhcode-cpp / grpo-loss
  ☆42Updated 11 months ago
• QipengGuo / NLP-Notes
  Notes of my introduction about NLP in Fudan University
  ☆37Updated 4 years ago
• OctopusMind / DPO
  dpo算法实现
  ☆50Updated last year
• yegcjs / mixinglaws
  ☆109Updated 6 months ago
• cooelf / PaperWritingTips
  Tips for paper writing and researches 科技论文写作经验记录和总结
  ☆139Updated 4 years ago
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆94Updated 2 months ago
• TobiasLee / Awesome-Efficient-PLM
  Must-read papers on improving efficiency for pre-trained language models.
  ☆105Updated 3 years ago
• seanzhang-zhichen / simcse-pytorch
  SimCSE
  ☆15Updated 3 years ago
• cavalierlulu / rag_survey
  ☆125Updated last year
• hazdzz / tiger
  A Tight-fisted Optimizer (Tiger), implemented in PyTorch.
  ☆12Updated last year
• fastnlp / ElasticBERT
  A pre-trained model with multi-exit transformer architecture.
  ☆56Updated 3 years ago
• intro-nlp / intro-nlp.github.io
  《自然语言处理概论》 张奇、桂韬、黄萱菁著
  ☆121Updated 2 years ago
• Magnetic2014 / llm-alignment-survey
  A curated reading list for large language model (LLM) alignment. Take a look at our new survey "Large Language Model Alignment: A Survey"…
  ☆80Updated 2 years ago
• cofe-ai / Mu-scaling
  Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales
  ☆32Updated 2 years ago
• nishiwen1214 / Benchmark-leakage-detection
  Official completion of “Training on the Benchmark Is Not All You Need”.
  ☆39Updated last year
• Trustworthy-Information-Access / When-to-Retrieve
  Implementation of "ACL'24: When Do LLMs Need Retrieval Augmentation? Mitigating LLMs’ Overconfidence Helps Retrieval Augmentation"
  ☆24Updated last year
• thu-coai / MiniPLM
  [ICLR 2025] MiniPLM: Knowledge Distillation for Pre-Training Language Models
  ☆73Updated last year
• nengwp / Lion-vs-Adam
  Lion and Adam optimization comparison
  ☆64Updated 2 years ago
• Longyichen / Alpaca-family-library
  Summarize all open source Large Languages Models and low-cost replication methods for Chatgpt.
  ☆136Updated 2 years ago
• yuleiqin / fantastic-data-engineering
  Fantastic Data Engineering for Large Language Models
  ☆93Updated last year
• LightR0 / hugging_face_tutorials
  ☆18Updated 3 years ago
• WhereIsAI / BiLLM
  Tool for converting LLMs from uni-directional to bi-directional by removing causal mask for tasks like classification and sentence embedd…
  ☆63Updated last year