Ongoing research training transformer language models at scale, including: BERT & GPT-2
☆19Jul 20, 2023Updated 3 years ago
Alternatives and similar repositories for Megatron-DeepSpeed
Users that are interested in Megatron-DeepSpeed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆84Sep 9, 2023Updated 2 years ago
- LORA微调BLOOMZ，参考BELLE☆25Mar 24, 2023Updated 3 years ago
- Awesome Entity Alignment is a collection of EA techniques, including papers, codes, and datasets.☆11Oct 27, 2022Updated 3 years ago
- BLOOM 模型的指令微调☆24Jun 15, 2023Updated 3 years ago
- train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism☆224Nov 21, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 收录实现中文版ChatGPT的各种技术路线，数据及其他资料☆35Jul 12, 2023Updated 3 years ago
- Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…☆53Jul 6, 2023Updated 3 years ago
- chinese wwm masking and ngram masking based on jieba☆11Jul 25, 2019Updated 7 years ago
- flow mirror models from JZX AI Labs☆43Sep 30, 2024Updated last year
- MXNet finetune baseline (res152) for challenger.ai/competition/scene☆11Sep 24, 2017Updated 8 years ago
- KDD 2024 AQA competition 2nd place solution☆12Jul 21, 2024Updated 2 years ago
- (NBCE)Naive Bayes-based Context Extension on ChatGLM-6b☆15Jun 7, 2023Updated 3 years ago
- 基于PaddleNLP开源的抽取式UIE进行医学命名实体识别（torch实现）☆44Aug 5, 2022Updated 4 years ago
- NTK scaled version of ALiBi position encoding in Transformer.☆69Aug 16, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [ICDAR 2023] SelfDocSeg: A self-supervised vision-based approach towards Document Segmentation (Oral)☆43Oct 6, 2023Updated 2 years ago
- 怎么训练一个LLM分词器☆152Jul 13, 2023Updated 3 years ago
- Finetuning LLaMA with DeepSpeed☆10Apr 14, 2023Updated 3 years ago
- Examples about using MGeo finetune models☆58Feb 9, 2023Updated 3 years ago
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆10Oct 11, 2024Updated last year
- DataFountain第五届达观杯第4名方案☆11Dec 3, 2021Updated 4 years ago
- This repository contains a Chinese KBQA dataset expanded from CCKS CKBQA Competition Dataset.☆13Jun 2, 2021Updated 5 years ago
- Multi-Figurative Language Generation (COLING 2022)☆12Jan 30, 2023Updated 3 years ago
- Yuren 13B is an information synthesis large language model that has been continuously trained based on Llama 2 13B, which builds upon the…☆15Sep 25, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆14Sep 6, 2024Updated last year
- Code for TACL 2020 paper "An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Models"☆14Jul 31, 2020Updated 6 years ago
- ☆12Apr 23, 2018Updated 8 years ago
- pytorch版基于gpt+nezha的中文多轮Cdial☆11Oct 22, 2022Updated 3 years ago
- 文言文信息抽取（实体识别+关系抽取）☆10Feb 24, 2023Updated 3 years ago
- OpenLLMDE: An open source data engineering framework for LLMs☆18Sep 9, 2023Updated 2 years ago
- Dual Cross Encoder for Dense Retrieval☆17Mar 15, 2023Updated 3 years ago
- Official code for the CVPR 2020 paper "Shoestring: Graph-Based Semi-Supervised Classification with Severely Limited Labeled Data."☆10Sep 23, 2020Updated 5 years ago
- ☆17Jul 10, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆16Apr 26, 2024Updated 2 years ago
- ☆306Apr 6, 2023Updated 3 years ago
- 该仓库目的是实现基于知识图谱的中文问答系统☆58Dec 22, 2021Updated 4 years ago
- An Experiment on Dynamic NTK Scaling RoPE☆64Nov 26, 2023Updated 2 years ago
- A Python implementation of Toolformer using Huggingface Transformers☆14Mar 20, 2023Updated 3 years ago
- Code and data for the paper: DTSM: Toward Dense Table Structure Recognition with Text Query Encoder and Adjacent Feature Aggregator☆14Apr 28, 2024Updated 2 years ago
- Memory experiments with LLMs☆11Mar 31, 2023Updated 3 years ago