An Affordable LLM Pre-training Benchmark via Accurate Loss Prediction across Scales
☆16Jun 6, 2024Updated 2 years ago
Alternatives and similar repositories for nanoLM
Users that are interested in nanoLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 智源研究院、旋玑智能、面壁智能发布的具身智能操作系统☆26Apr 8, 2026Updated 6 months ago
- Masked Structural Growth for 2x Faster Language Model Pre-training☆26Apr 28, 2024Updated 2 years ago
- Codebase for the arxiver dataset☆14Nov 29, 2024Updated last year
- ☆12Jan 9, 2024Updated 2 years ago
- An attempt to bring command history trough keyboard shortcuts to rc shell inside rio window following the philosophy of modularity.☆10Jul 20, 2026Updated 3 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- Code from my thesis Articulated 3D Hand from a Single RGB Image, later published as Monocular 3D Hand Pose Estimation with Implicit Camer…☆14Jun 16, 2025Updated last year
- Gumbo - A pure-C HTML5 parser, adapted to be installable via clib.☆12Jun 8, 2021Updated 5 years ago
- Visegrad+ Parliament API. Access to parliament data of Visegrad+ countries in a common data standard.☆11May 17, 2016Updated 10 years ago
- Interpretable Charge Predictions for Criminal Cases: Learning to Generate Court Views from Fact Descriptions☆16May 7, 2018Updated 8 years ago
- Code for the paper "Hedging with linear regressions and neural networks"☆41May 14, 2021Updated 5 years ago
- Latent Large Language Models☆19Aug 24, 2024Updated 2 years ago
- Code for "The Surprising Agreement Between Convex Optimization Theory and Learning-Rate Scheduling for Large Model Training"☆11Feb 4, 2026Updated 9 months ago
- Modern parallelism techniques for training LLMs☆13May 21, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Parallel Associative Scan for Language Models☆18Jan 8, 2024Updated 2 years ago
- KL3M tokenizers☆15Apr 24, 2025Updated last year
- 2023 ABCI Llama-2 継続学習プロジェクト☆14Jan 22, 2024Updated 2 years ago
- Remove duplicates and near-duplicates from text corpora, no matter the scale.☆13Nov 24, 2023Updated 2 years ago
- This is the public repository of AAAI 2024 paper "Is a Large Language Model a Good Annotator for Event Extraction"☆10Feb 16, 2024Updated 2 years ago
- ☆16Apr 3, 2024Updated 2 years ago
- [TMLR] "Can You Win Everything with Lottery Ticket?" by Tianlong Chen, Zhenyu Zhang, Jun Wu, Randy Huang, Sijia Liu, Shiyu Chang, Zhangy…☆10Sep 8, 2022Updated 4 years ago
- HPKE implementation for Zig.☆18Oct 28, 2026Updated last week
- ☆12Dec 13, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A PyTorch wrapper of parallel exclusive scan in CUDA☆12May 25, 2023Updated 3 years ago
- A C-based checksec without readelf or grep dependance.☆11Apr 20, 2021Updated 5 years ago
- ☆11Aug 10, 2024Updated 2 years ago
- An open-source implementation of Scaling Laws for Neural Language Models using nanoGPT☆60Dec 8, 2023Updated 2 years ago
- Detect and execute esoteric programming language code.☆14Jan 6, 2023Updated 3 years ago
- Causal Inference for Time Series Data (with CausalML Demo)☆14Jun 11, 2023Updated 3 years ago
- WebAssembly port of Plan9 (fourth edition) libraries, device drivers, file systems and Inferno kernel☆20Jan 30, 2023Updated 3 years ago
- The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”☆17Feb 26, 2024Updated 2 years ago
- Getting GPU Util 99%☆33Feb 1, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Network Etiquette (Netiquette) -- Written with 2020 technology in mind☆10Nov 19, 2021Updated 4 years ago
- T-GCN交通流量动态预测，需要研究如何把流速转化为流量☆10Oct 17, 2019Updated 7 years ago
- ☆21Apr 16, 2025Updated last year
- Training a BERT model from scratch.☆11Oct 15, 2023Updated 3 years ago
- the Pytorch implementation for our EMNLP 2021 paper "Learning Neural Templates for Recommender Dialogue System"☆31Apr 11, 2022Updated 4 years ago
- ☆12Nov 6, 2023Updated 3 years ago
- source code of (quasi-)Givens Orthogonal Fine Tuning integrated to peft lib☆16Mar 13, 2025Updated last year