Ongoing research training transformer language models at scale, including: BERT & GPT-2
☆19Jul 20, 2023Updated 2 years ago
Alternatives and similar repositories for Megatron-DeepSpeed
Users that are interested in Megatron-DeepSpeed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆84Sep 9, 2023Updated 2 years ago
- LORA微调BLOOMZ，参考BELLE☆25Mar 24, 2023Updated 3 years ago
- Awesome Entity Alignment is a collection of EA techniques, including papers, codes, and datasets.☆11Oct 27, 2022Updated 3 years ago
- Debug DeepSpeed-Chat step by step in IDE (在IDE里一步一步调试DeepSpeed-Chat)☆10Apr 17, 2023Updated 3 years ago
- Control 3f robotiq gripper using python and modbus client☆15Jun 27, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- BLOOM 模型的指令微调☆24Jun 15, 2023Updated 3 years ago
- Implementation of Unified Embedding: Battle-Tested Feature Representations for Web-Scale ML Systems☆15Nov 11, 2023Updated 2 years ago
- Vlaser: Vision-Language-Action Model with Synergistic Embodied Reasoning☆49Mar 18, 2026Updated 3 months ago
- train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism☆224Nov 21, 2023Updated 2 years ago
- [TMLR 2026] LLM-FE: Automated Feature Engineering with Large Language Models☆75May 10, 2026Updated last month
- Automated detection of exudates from fundus images plays an important role in diabetic retinopathy (DR) screening and evaluation, for whi…☆11Dec 11, 2020Updated 5 years ago
- Release the power of GPT☆11May 27, 2024Updated 2 years ago
- Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…☆54Jul 6, 2023Updated 3 years ago
- This project utilizes deep reinforcement learning techniques to train a robot, which combines a mobile platform and a Panda robotic arm, …☆11Jun 7, 2023Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- flow mirror models from JZX AI Labs☆43Sep 30, 2024Updated last year
- MXNet finetune baseline (res152) for challenger.ai/competition/scene☆11Sep 24, 2017Updated 8 years ago
- 基于PaddleNLP开源的抽取式UIE进行医学命名实体识别（torch实现）☆44Aug 5, 2022Updated 3 years ago
- (NBCE)Naive Bayes-based Context Extension on ChatGLM-6b☆15Jun 7, 2023Updated 3 years ago
- Class Incremental learning, Task Incremental Learning☆17Dec 19, 2022Updated 3 years ago
- A CLI tool and library written in Go for converting documents to Markdown format.☆25Sep 27, 2025Updated 9 months ago
- 爬取自互联网的古诗词语料库，包含先秦至当代诗词，共计1014508首诗☆50Mar 18, 2022Updated 4 years ago
- NTK scaled version of ALiBi position encoding in Transformer.☆69Aug 16, 2023Updated 2 years ago
- [ICDAR 2023] SelfDocSeg: A self-supervised vision-based approach towards Document Segmentation (Oral)☆43Oct 6, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 怎么训练一个LLM分词器☆152Jul 13, 2023Updated 2 years ago
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆11Oct 11, 2024Updated last year
- 百度迁徙指数以及流出去向，全国所有地级市精度☆11May 30, 2020Updated 6 years ago
- This repository contains a Chinese KBQA dataset expanded from CCKS CKBQA Competition Dataset.☆13Jun 2, 2021Updated 5 years ago
- Yuren 13B is an information synthesis large language model that has been continuously trained based on Llama 2 13B, which builds upon the…☆15Sep 25, 2023Updated 2 years ago
- Examples about using MGeo finetune models☆57Feb 9, 2023Updated 3 years ago
- DataFountain第五届达观杯第4名方案☆11Dec 3, 2021Updated 4 years ago
- A method for event correlation detection based on Spatial-Temporal-Textual point process☆13Dec 16, 2019Updated 6 years ago
- Multi-Figurative Language Generation (COLING 2022)☆12Jan 30, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Oct 8, 2022Updated 3 years ago
- ☆12Apr 23, 2018Updated 8 years ago
- ☆14May 25, 2023Updated 3 years ago
- pytorch版基于gpt+nezha的中文多轮Cdial☆11Oct 22, 2022Updated 3 years ago
- 文言文信息抽取（实体识别+关系抽取）☆10Feb 24, 2023Updated 3 years ago
- Generation and MLE Estimation for Multivariate Hawkes Process☆11Oct 3, 2019Updated 6 years ago
- Reproduced the DFT method without using Verl. https://arxiv.org/abs/2508.05629☆23Oct 14, 2025Updated 8 months ago