karpathy / nano-llama31
nanoGPT style version of Llama 3.1
☆1,162Updated last month
Related projects: ⓘ
- MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.☆929Updated 2 weeks ago
- The n-gram Language Model☆1,288Updated last month
- The Multilayer Perceptron Language Model☆503Updated last month
- The Autograd Engine☆482Updated last week
- Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"☆774Updated 3 weeks ago
- llama3.np is a pure NumPy implementation for Llama 3 model.☆955Updated 3 months ago
- UNet diffusion model in pure CUDA☆562Updated 2 months ago
- DataComp for Language Models☆1,108Updated 2 weeks ago
- A Native-PyTorch Library for LLM Fine-tuning☆3,942Updated this week
- High-quality datasets, tools, and concepts for LLM fine-tuning.☆1,664Updated last month
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,309Updated 5 months ago
- The Tensor (or Array)☆388Updated last month
- A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 and reasoning techniques.☆1,230Updated this week
- Open weights language model from Google DeepMind, based on Griffin.☆592Updated 2 months ago
- System 2 Reasoning Link Collection☆597Updated this week
- 4M: Massively Multimodal Masked Modeling☆1,543Updated 2 months ago
- A native PyTorch Library for large model training☆1,544Updated this week
- Reaching LLaMA2 Performance with 0.1M Dollars☆955Updated last month
- Schedule-Free Optimization in PyTorch☆1,800Updated last month
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.☆1,756Updated last month
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models☆782Updated 5 months ago
- Run PyTorch LLMs locally on servers, desktop and mobile☆3,100Updated this week
- MINT-1T: A one trillion token multimodal interleaved dataset.☆729Updated last month
- ☆2,652Updated this week
- Tile primitives for speedy kernels☆1,489Updated this week
- A family of open-sourced Mixture-of-Experts (MoE) Large Language Models☆1,352Updated 6 months ago
- ReFT: Representation Finetuning for Language Models☆1,076Updated 2 weeks ago
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆662Updated last month
- Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors a…☆1,131Updated this week
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.☆1,542Updated last week