Alternatives and similar repositories for Little-GPT

Users that are interested in Little-GPT are comparing it to the libraries listed below

• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated 2 years ago
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 8 months ago
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated last year
• kyegomez / SelfExtend
  Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta
  ☆13Updated 7 months ago
• ConiferLabsWA / flan-ul2-alpaca
  ☆32Updated 2 years ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 11 months ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• donaldafeith / Pytorch_Merge
  Merge LLM that are split in to parts
  ☆26Updated last year
• Zyphra / Zyda_processing
  ☆35Updated last year
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• huggingface / peft-pytorch-conference
  Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…
  ☆14Updated last year
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated 2 years ago
• vaguenebula / AlpacaDataReflect
  An experiment to see if chatgpt can improve the output of the stanford alpaca dataset
  ☆12Updated 2 years ago
• iPieter / universal-distillation
  🧪Create domain-adapted language models by distilling from many pre-trained LMs
  ☆10Updated 2 years ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• NL2Code / CodeM
  ☆44Updated last year
• Narsil / bloomserver
  ☆39Updated 2 years ago
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆35Updated last year
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆26Updated 8 months ago
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆71Updated last year
• finetunej / transformers
  🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
  ☆56Updated 3 years ago
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆32Updated 10 months ago
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• EleutherAI / semantic-memorization
  ☆44Updated 7 months ago
• catid / lllm
  Latent Large Language Models
  ☆18Updated 10 months ago
• TheoCoombes / crawlingathome
  A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.
  ☆32Updated 2 years ago
• Agora-Lab-AI / Orca
  An Implementation of "Orca: Progressive Learning from Complex Explanation Traces of GPT-4"
  ☆43Updated 8 months ago
• AXKuhta / rwkv-onnx-dml
  Run ONNX RWKV-v4 models with GPU acceleration using DirectML [Windows], or just on CPU [Windows AND Linux]; Limited to 430M model at this…
  ☆21Updated 2 years ago
• nyu-mll / ILF-for-code-generation
  ☆76Updated 3 months ago