从零开始学大模型Transformer、GPT2、BERT pre-training and fine-tuning from scratch
☆38Jul 1, 2024Updated last year
Alternatives and similar repositories for LLM-from-scratch
Users that are interested in LLM-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 医疗问诊系统multi-agent框架☆93Mar 30, 2025Updated 11 months ago
- Multimodal reasoning based on knowledge graph embedding for specific diseases☆13Apr 29, 2024Updated last year
- 文言文信息抽取（实体识别+关系抽取）☆10Feb 24, 2023Updated 3 years ago
- 使用biaffine的中文命名实体识别☆10Jan 12, 2023Updated 3 years ago
- Accepted at WWW 25 Industrial Track (oral)☆17Jun 6, 2025Updated 9 months ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- ⛏️This is the storage of my Slides、Reports and Papers. | 存储PPT、报告和论文☆12Oct 27, 2024Updated last year
- Code of the Grounded MUIE model, REAMO☆11Dec 3, 2024Updated last year
- A Transformer Framework Based Classification Task☆26Feb 26, 2024Updated 2 years ago
- ☆12Apr 25, 2024Updated last year
- ☆31May 10, 2024Updated last year
- Official implementation of our work, GATE: Graph Attention Transformer Encoder for Cross-lingual Relation and Event Extraction [AAAI 2021…☆50Apr 16, 2023Updated 2 years ago
- ☆48Oct 17, 2025Updated 5 months ago
- 基于python3训练中文wiki词向量、字向量、拼音向量☆11Jan 2, 2022Updated 4 years ago
- Pytorch implementation of DeepLOB-ATT and DeepLOB-Seq2Seq from Multi Horizon Forecasting for Limit Order Books☆14Feb 4, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Operator Deep Smoothing☆14Feb 7, 2025Updated last year
- Yet Another PyTorch Tutorial☆12Jan 18, 2021Updated 5 years ago
- Code repository to analyse the performance and results of selected LLMs using the MIMIC CDM dataset.☆21Dec 22, 2025Updated 3 months ago
- 华南师范大学软件协会香农先修班主要在2021秋季学期和2022春季学期的部分公开资料，包括以我本人为唯一作者或主要作者的课件、算法比赛资料(题面、题解、判题std数据、SPJ)。☆15Dec 20, 2023Updated 2 years ago
- CBLUE2.0-关系抽取模型，基于pytorch☆17Oct 23, 2024Updated last year
- ☆21Updated this week
- This project demonstrates the computation process of the RWKV (Receptance Weighted Key Value) model through Excel spreadsheets.☆20Jun 7, 2025Updated 9 months ago
- 最基本最小白的自然语言处理入门读物，基于deepseek-r1，涵盖了传统NLP和现代大模型☆23Jan 16, 2026Updated 2 months ago
- These are my lecture notes and code for Coursera online course Functional Programming Principles in Scala by Prof. Martin Odersky from Éc…☆21Jan 7, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- bert_avg，bert_whitening，sbert，consert，simcse，esimcse 中文句向量表示☆15Apr 7, 2022Updated 3 years ago
- ☆14Sep 20, 2024Updated last year
- auto_spectral_clustering predicts number of clusters based on the eigengap.☆12Mar 31, 2021Updated 4 years ago
- ☆16Oct 31, 2022Updated 3 years ago
- 基于simcse的中文句向量生成☆16Jun 8, 2022Updated 3 years ago
- 该系列的目的是让读者可以在基础的pytorch上，不依赖任何其他现成的外部库，从零开始理解并实现一个大语言模型的所有组成部分，以及训练微调代码，因此读者仅需python，pytorch和最基础深度学习背景知识即可。☆385Aug 28, 2025Updated 7 months ago
- 兼容 diff 的多交易所行情发送方案☆42Oct 24, 2025Updated 5 months ago
- ☆58Dec 3, 2025Updated 3 months ago
- This repo contains our PyTorch implementation for the paper Selecting Optimal Context Sentences for Event-Event Relation Extraction.☆14Nov 25, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- ☆58Feb 7, 2025Updated last year
- thread and atomic library☆29Apr 11, 2020Updated 5 years ago
- D ratio is a performance metric to analyse the efficiency of algorithms that predict asset return or asset prices☆25Feb 22, 2024Updated 2 years ago
- One click away from a locally downloaded, fine-tuned model, hosted on hugging face, with inference built in. In two hours.☆24Nov 9, 2025Updated 4 months ago
- image classifier on stm32☆29Nov 30, 2019Updated 6 years ago
- [AAAI Oral 2026] This is the official code of our Paper "Sonnet: Spectral Operator Neural Network for Multivariable Time Series Forecasti…☆45Mar 20, 2026Updated last week
- 毕业设计（医疗问答系统）☆28Mar 28, 2022Updated 4 years ago