jaymody / picoGPTLinks
An unnecessarily tiny implementation of GPT-2 in NumPy.
☆3,360Updated 2 years ago
Alternatives and similar repositories for picoGPT
Users that are interested in picoGPT are comparing it to the libraries listed below
Sorting:
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,060Updated 8 months ago
- The RedPajama-Data repository contains code for preparing large datasets for training large language models.☆4,727Updated 5 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆41,517Updated 5 months ago
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,498Updated last year
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆8,515Updated last year
- LLaMA: Open and Efficient Foundation Language Models☆2,799Updated last year
- Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)☆2,634Updated 2 years ago
- High-speed download of LLaMA, Facebook's 65B parameter GPT model☆4,162Updated last year
- ☆3,973Updated last year
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,645Updated 8 months ago
- A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer☆1,632Updated last year
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,462Updated 11 months ago
- The hub for EleutherAI's work on interpretability and learning dynamics☆2,500Updated last week
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆4,652Updated last year
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,416Updated 9 months ago
- Instruct-tune LLaMA on consumer hardware☆18,909Updated 10 months ago
- Simple UI for LLM Model Finetuning☆2,060Updated last year
- Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.☆3,660Updated last year
- Instruction Tuning with GPT-4☆4,302Updated last year
- LLM as a Chatbot Service☆3,318Updated last year
- ☆4,423Updated 10 months ago
- ☆4,083Updated 11 months ago
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆13,645Updated last week
- Notebooks and various random fun☆1,094Updated 2 years ago
- Running large language models on a single GPU for throughput-oriented scenarios.☆9,322Updated 7 months ago
- Accessible large language models via k-bit quantization for PyTorch.☆7,088Updated this week
- Numbers every LLM developer should know☆4,230Updated last year
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,874Updated last year
- Inference Llama 2 in one file of pure C☆18,439Updated 9 months ago
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆6,898Updated 10 months ago