Alternatives and similar repositories for picoGPT

Users that are interested in picoGPT are comparing it to the libraries listed below

• Lightning-AI / lit-llama
  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…
  ☆6,089Updated 5 months ago
• togethercomputer / RedPajama-Data
  The RedPajama-Data repository contains code for preparing large datasets for training large language models.
  ☆4,897Updated last year
• young-geng / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆2,503Updated last year
• trholding / llama2.c
  Llama 2 Everywhere (L2E)
  ☆1,521Updated 3 months ago
• henrywoo / pyllama
  LLaMA: Open and Efficient Foundation Language Models
  ☆2,800Updated 2 years ago
• openlm-research / open_llama
  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
  ☆7,527Updated 2 years ago
• paperswithcode / galai
  Model API for GALACTICA
  ☆2,742Updated 2 years ago
• tairov / llama2.mojo
  Inference Llama 2 in one file of pure 🔥
  ☆2,115Updated 2 weeks ago
• lucidrains / PaLM-rlhf-pytorch
  Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
  ☆7,870Updated 2 months ago
• apple / ml-ane-transformers
  Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)
  ☆2,668Updated 2 years ago
• lucidrains / toolformer-pytorch
  Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI
  ☆2,057Updated last year
• CarperAI / trlx
  A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
  ☆4,730Updated last year
• EleutherAI / pythia
  The hub for EleutherAI's work on interpretability and learning dynamics
  ☆2,689Updated last month
• meta-pytorch / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆6,165Updated 3 months ago
• FMInference / FlexLLMGen
  Running large language models on a single GPU for throughput-oriented scenarios.
  ☆9,380Updated last year
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆19,015Updated last year
• karpathy / ng-video-lecture
  ☆4,406Updated last year
• JonasGeiping / cramming
  Cramming the training of a (BERT-type) language model into limited compute.
  ☆1,354Updated last year
• openai / transformer-debugger
  ☆4,109Updated last year
• facebookresearch / metaseq
  Repo for external large-scale work
  ☆6,547Updated last year
• shawwn / llama-dl
  High-speed download of LLaMA, Facebook's 65B parameter GPT model
  ☆4,155Updated 2 years ago
• project-baize / baize-chatbot
  Let ChatGPT teach your own chatbot in hours with a single GPU!
  ☆3,168Updated last year
• deep-diver / LLM-As-Chatbot
  LLM as a Chatbot Service
  ☆3,339Updated 2 years ago
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,851Updated last year
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,194Updated 2 years ago
• ray-project / llm-numbers
  Numbers every LLM developer should know
  ☆4,273Updated last year
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆7,147Updated last year
• BlinkDL / RWKV-LM
  RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…
  ☆14,220Updated this week
• teknium1 / GPTeacher
  A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer
  ☆1,630Updated 2 years ago
• s-JoL / Open-Llama
  The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.
  ☆52Updated 2 years ago