Alternatives and similar repositories for Little-GPT:

Users that are interested in Little-GPT are comparing it to the libraries listed below

• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 2 years ago
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated last year
• TheoCoombes / crawlingathome
  A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.
  ☆32Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆43Updated 6 months ago
• Zyphra / Zyda_processing
  ☆31Updated 8 months ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆46Updated last year
• ConiferLabsWA / flan-ul2-alpaca
  ☆32Updated last year
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated last year
• donaldafeith / Pytorch_Merge
  Merge LLM that are split in to parts
  ☆26Updated last year
• codekansas / rwkv
  RWKV model implementation
  ☆37Updated last year
• VE-FORBRYDERNE / mtj-softtuner
  Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance
  ☆27Updated last year
• NL2Code / CodeM
  ☆44Updated 8 months ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆18Updated 4 months ago
• yuxdux / kinda-llama
  An open-source replication and extension of the Meta AI's LLAMA dataset
  ☆24Updated last year
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 3 months ago
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆63Updated last year
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 3 weeks ago
• nyu-mll / ILF-for-code-generation
  ☆74Updated last year
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated last year
• JHU-CLSP / RATIONALYST
  Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044
  ☆32Updated 4 months ago
• EleutherAI / semantic-memorization
  ☆44Updated 3 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 10 months ago
• AeroScripts / HiddenEngrams
  Hidden Engrams: Long Term Memory for Transformer Model Inference
  ☆35Updated 3 years ago
• InflectionAI / Inflection-Benchmarks
  Public Inflection Benchmarks
  ☆69Updated 11 months ago
• AlexWan0 / infini-gram
  An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)
  ☆30Updated 8 months ago
• EleutherAI / best-download
  URL downloader supporting checkpointing and continuous checksumming.
  ☆19Updated last year
• cloneofsimo / auto_llm_codebase_analysis
  ☆26Updated 11 months ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated last week