eniompw / nanoGPTshakespeare
finetuning shakespeare on karpathy/nanoGPT
☆19Updated 2 years ago
Alternatives and similar repositories for nanoGPTshakespeare:
Users that are interested in nanoGPTshakespeare are comparing it to the libraries listed below
- Fine-tune and quantize Llama-2-like models to generate Python code using QLoRA, Axolot,..☆64Updated last year
- aesthetic tensor visualiser☆15Updated this week
- Repository containing awesome resources regarding Hugging Face tooling.☆46Updated last year
- Testing KAN-based text generation GPT models☆16Updated 11 months ago
- A repository of projects and datasets under active development by Alignment Lab AI☆22Updated last year
- 🚀 Automatically convert unstructured data into a high-quality 'textbook' format, optimized for fine-tuning Large Language Models (LLMs)☆26Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- ☆29Updated last month
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 5 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated 2 months ago
- ☆24Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Finetuning BLOOM on a single GPU using gradient-accumulation☆30Updated 2 years ago
- Because it's there.☆16Updated 7 months ago
- Building large language foundational model☆9Updated last month
- Simple GRPO scripts and configurations.☆58Updated 2 months ago
- ☆87Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 11 months ago
- A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.☆16Updated 6 months ago
- ☆35Updated last year
- Tools for merging pretrained large language models.☆19Updated 10 months ago
- Very minimal (and stateless) agent framework☆42Updated 3 months ago
- RAG Agent for the ARC AGI Challenge☆21Updated 9 months ago
- A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.☆22Updated 3 weeks ago
- Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA☆103Updated 8 months ago
- alternative way to calculating self attention☆18Updated 11 months ago
- ☆61Updated last year
- A tutorial for building autonomous agents: with LangChain and from scratch☆26Updated last year
- ☆52Updated 2 months ago
- OpenPipe Reinforcement Learning Experiments☆22Updated last month