An Affordable LLM Pre-training Benchmark via Accurate Loss Prediction across Scales
☆16Jun 6, 2024Updated 2 years ago
Alternatives and similar repositories for nanoLM
Users that are interested in nanoLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Masked Structural Growth for 2x Faster Language Model Pre-training☆25Apr 28, 2024Updated 2 years ago
- Latent Large Language Models☆19Aug 24, 2024Updated last year
- Lightweight and minimal dom template and ajax helpers☆19Dec 15, 2023Updated 2 years ago
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- An implementation of the hammer2 filesystem for Plan 9☆19Nov 25, 2018Updated 7 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- An open-source implementation of Scaling Laws for Neural Language Models using nanoGPT☆55Dec 8, 2023Updated 2 years ago
- Simple Application Sandboxing☆25Aug 9, 2024Updated last year
- An algorithm that intelligently executes a crypto order over time via Coinbase☆13Oct 26, 2021Updated 4 years ago
- I use various Data Science and machine learning techniques to analyze customer data using STP framework. I preprocessed the data, perform…☆11Apr 26, 2020Updated 6 years ago
- We systematically studied the influencing factors when LLM generates benchmarks,By using our code, you can generate high-quality QA datas…☆20May 20, 2025Updated last year
- Parallel Associative Scan for Language Models☆18Jan 8, 2024Updated 2 years ago
- Estimating hardware and cloud costs of LLMs and transformer projects☆22Apr 1, 2026Updated 3 months ago
- Detect and execute esoteric programming language code.☆14Jan 6, 2023Updated 3 years ago
- The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”☆17Feb 26, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12Dec 13, 2023Updated 2 years ago
- Getting GPU Util 99%☆33Feb 1, 2021Updated 5 years ago
- Implements pre-training, supervised fine-tuning (SFT), and reinforcement learning from human feedback (RLHF), to train and fine-tune the …☆57Mar 9, 2024Updated 2 years ago
- [NeurIPS'24 Spotlight] Observational Scaling Laws☆60Oct 2, 2024Updated last year
- ☆11Aug 10, 2024Updated last year
- the Pytorch implementation for our EMNLP 2021 paper "Learning Neural Templates for Recommender Dialogue System"☆31Apr 11, 2022Updated 4 years ago
- A PyTorch wrapper of parallel exclusive scan in CUDA☆12May 25, 2023Updated 3 years ago
- A C-based checksec without readelf or grep dependance.☆11Apr 20, 2021Updated 5 years ago
- ☆11Jul 23, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- source code of (quasi-)Givens Orthogonal Fine Tuning integrated to peft lib☆16Mar 13, 2025Updated last year
- Helpful scripts for running models in lavaan that reproduce published findings☆17Apr 18, 2018Updated 8 years ago
- Network Etiquette (Netiquette) -- Written with 2020 technology in mind☆10Nov 19, 2021Updated 4 years ago
- Training a BERT model from scratch.☆11Oct 15, 2023Updated 2 years ago
- Minimal Kréta client written in Python.☆11Oct 7, 2023Updated 2 years ago
- ☆10Sep 30, 2020Updated 5 years ago
- this project is developing to crawl stock A finance and trade data from website, process finance and trade data to get factors, and then …☆17Jan 12, 2023Updated 3 years ago
- ☆23Aug 7, 2023Updated 2 years ago
- Minimalist RSS/Atom aggregator 📰☆23Oct 11, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Ruby Gem that makes sure that only a single instance of a code block is running.☆16Mar 13, 2013Updated 13 years ago
- Go port to plan9/arm64☆18Mar 11, 2025Updated last year
- A Docker image is a piece of executable code that produces some output given some input.☆26Feb 19, 2026Updated 5 months ago
- Samson's MIT Master's Degree Thesis: "Multi-Agent Deep Reinforcement Learning and GAN-Based Market Simulation for Derivatives Pricing and…☆23Jul 11, 2026Updated 2 weeks ago
- [ACL'26] Official Repository for for paper "Data-Efficient RLVR via Off-Policy Influence Guidance"☆25Mar 29, 2026Updated 3 months ago
- WebAssembly port of Plan9 (fourth edition) libraries, device drivers, file systems and Inferno kernel☆20Jan 30, 2023Updated 3 years ago
- 🧰 (Almost) unique identicons - Based on SHA-1 and inspired by folded paper.☆25Dec 4, 2021Updated 4 years ago