โ78Dec 7, 2023Updated 2 years ago
Alternatives and similar repositories for lm_dataformat
Users that are interested in lm_dataformat are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A utility for storing and reading files for Korean LM training ๐พโ35Jul 18, 2026Updated 4 months ago
- Convenient Text-to-Text Training for Transformersโ18Dec 10, 2021Updated 4 years ago
- โ1,680Apr 27, 2023Updated 3 years ago
- โ94Jul 16, 2022Updated 4 years ago
- Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasetsโ131Nov 12, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean โข AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- See the issue board for the current status of active and prospective projects!โ66Feb 12, 2022Updated 4 years ago
- Script for downloading GitHub.โ99Jul 1, 2024Updated 2 years ago
- Pile Deduplication Codeโ18May 15, 2023Updated 3 years ago
- Python Research Frameworkโ107Nov 3, 2022Updated 4 years ago
- โ131Jun 9, 2022Updated 4 years ago
- A simple Transformer where the softmax has been replaced with normalizationโ20Sep 11, 2020Updated 6 years ago
- โ24Nov 22, 2022Updated 3 years ago
- Train ๐คtransformers with DeepSpeed: ZeRO-2, ZeRO-3โ23May 20, 2021Updated 5 years ago
- An easy way to start a python programming environment using GitHub Codespaces.โ15Sep 9, 2020Updated 6 years ago
- Virtual machines for every use case on DigitalOcean โข AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Downloads 2020 English Wikipedia articles as plaintextโ27Mar 25, 2023Updated 3 years ago
- annotated-transformer-krโ15May 16, 2019Updated 7 years ago
- ์ ๋ฌด์๋ํ๋ฅผ ์ํ Python ๊ฐ์๋ฅผ ๋ฃ๊ณ ์ ๋ฆฌํ ์๋ฃโ13Oct 10, 2017Updated 9 years ago
- Anonymous ICLR Submissionโ14Sep 25, 2019Updated 7 years ago
- DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.โ172Aug 23, 2026Updated 2 months ago
- Calculating Expected Time for training LLM.โ39Apr 17, 2023Updated 3 years ago
- Reproducible encoder downstream fine-tune eval harnessโ11Jul 27, 2026Updated 3 months ago
- huggingface๋ฅผ ์ด์ฉํ์ฌ downstream task ์ํํ๊ธฐโ62Dec 28, 2021Updated 4 years ago
- nbdev docs lookup for a few libraries and python itselfโ26Feb 9, 2026Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways โข AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- โ45Nov 17, 2024Updated 2 years ago
- โ35Apr 18, 2021Updated 5 years ago
- Code for the paper "Closing the Curious Case of Neural Text Degeneration"โ12Apr 9, 2025Updated last year
- โ39Mar 25, 2024Updated 2 years ago
- kogpt๋ฅผ oslo๋ก ํ์ธํ๋ํ๋ ์์ .โ23Aug 26, 2022Updated 4 years ago
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluationโ11May 27, 2022Updated 4 years ago
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant โฆโ15Mar 11, 2024Updated 2 years ago
- #์ธ๊ถ์ฝํผ์คโ31Oct 6, 2023Updated 3 years ago
- โ14Dec 9, 2021Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available โข AdRun AI, ML, and HPC workloads on powerful cloud GPUsโwithout limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- OSLO: Open Source framework for Large-scale model Optimizationโ310Aug 25, 2022Updated 4 years ago
- โ10Dec 6, 2019Updated 6 years ago
- โ24Jun 30, 2026Updated 4 months ago
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weightsโ20Oct 9, 2022Updated 4 years ago
- Scaling Data-Constrained Language Modelsโ352Jun 28, 2025Updated last year
- Adapting the "Radioactive Data" paper to work for text modelsโ12Dec 23, 2020Updated 5 years ago
- KoGPT2 on Huggingface Transformersโ33May 4, 2021Updated 5 years ago
Are these results useful?