Ongoing research training transformer language models at scale, including: BERT & GPT-2
☆19Jul 20, 2023Updated 3 years ago
Alternatives and similar repositories for Megatron-DeepSpeed
Users that are interested in Megatron-DeepSpeed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆84Sep 9, 2023Updated 3 years ago
- Awesome Entity Alignment is a collection of EA techniques, including papers, codes, and datasets.☆11Oct 27, 2022Updated 3 years ago
- Debug DeepSpeed-Chat step by step in IDE (在IDE里一步一步调试DeepSpeed-Chat)☆10Apr 17, 2023Updated 3 years ago
- BLOOM 模型的指令微调☆24Jun 15, 2023Updated 3 years ago
- ☆12Jul 7, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Retinal lesions segmentation using CNNs and adversarial training: A Degree Thesis Submitted to the Faculty of Escola Tècnica d’Enginyeria…☆10Oct 27, 2019Updated 6 years ago
- train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism☆224Nov 21, 2023Updated 2 years ago
- 持续追踪ChatGPT相关的技术资料和行业进展。☆12Apr 24, 2023Updated 3 years ago
- Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…☆53Jul 6, 2023Updated 3 years ago
- This project utilizes deep reinforcement learning techniques to train a robot, which combines a mobile platform and a Panda robotic arm, …☆11Jun 7, 2023Updated 3 years ago
- chinese wwm masking and ngram masking based on jieba☆11Jul 25, 2019Updated 7 years ago
- flow mirror models from JZX AI Labs☆43Sep 30, 2024Updated 2 years ago
- A list of advice on doing research that is useful for me :)☆13Aug 17, 2019Updated 7 years ago
- (NBCE)Naive Bayes-based Context Extension on ChatGLM-6b☆15Jun 7, 2023Updated 3 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- 基于PaddleNLP开源的抽取式UIE进行医学命名实体识别（torch实现）☆44Aug 5, 2022Updated 4 years ago
- Resources for our AAAI 2022 paper: "Unsupervised Editing for Counterfactual Stories".☆13Oct 25, 2022Updated 3 years ago
- Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking☆13Feb 5, 2023Updated 3 years ago
- NTK scaled version of ALiBi position encoding in Transformer.☆69Aug 16, 2023Updated 3 years ago
- Implementation of Unified Embedding: Battle-Tested Feature Representations for Web-Scale ML Systems☆15Nov 11, 2023Updated 2 years ago
- 怎么训练一个LLM分词器☆152Jul 13, 2023Updated 3 years ago
- Finetuning LLaMA with DeepSpeed☆10Apr 14, 2023Updated 3 years ago
- Control 3f robotiq gripper using python and modbus client☆15Jun 27, 2024Updated 2 years ago
- （撰写ing..)本仓库偏教程性质，以「模型中文化」为一个典型的模型训练问题切入场景，指导读者上手学习LLM二次微调训练。☆36Aug 5, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- DataFountain第五届达观杯第4名方案☆11Dec 3, 2021Updated 4 years ago
- This repository contains a Chinese KBQA dataset expanded from CCKS CKBQA Competition Dataset.☆13Jun 2, 2021Updated 5 years ago
- Multi-Figurative Language Generation (COLING 2022)☆12Jan 30, 2023Updated 3 years ago
- Yuren 13B is an information synthesis large language model that has been continuously trained based on Llama 2 13B, which builds upon the…☆15Sep 25, 2023Updated 3 years ago
- ☆14Sep 6, 2024Updated 2 years ago
- ROS wrapper for DNN based robotic grasping algorithms☆21Nov 5, 2022Updated 3 years ago
- ☆12Apr 23, 2018Updated 8 years ago
- Model your data with the Von Mises-Fisher distribution in Python☆14Feb 1, 2016Updated 10 years ago
- pytorch版基于gpt+nezha的中文多轮Cdial☆11Oct 22, 2022Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆18May 21, 2021Updated 5 years ago
- Deep Robotic Grasping using Generative Residual Convolutional Neural Networks that can generate robust antipodal grasps from RGB-D input …☆20Dec 14, 2022Updated 3 years ago
- 文言文信息抽取（实体识别+关系抽取）☆10Feb 24, 2023Updated 3 years ago
- OpenLLMDE: An open source data engineering framework for LLMs☆18Sep 9, 2023Updated 3 years ago
- a simple asr system☆14Mar 8, 2018Updated 8 years ago
- Dual Cross Encoder for Dense Retrieval☆17Mar 15, 2023Updated 3 years ago
- ☆27Jul 13, 2023Updated 3 years ago