Alternatives and similar repositories for smol-gpt

Users that are interested in smol-gpt are comparing it to the libraries listed below

• mobarski / alpaca-libre
  Reimplementation of the task generation part from the Alpaca paper
  ☆118Updated 2 years ago
• geov-ai / geov
  The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…
  ☆121Updated 2 years ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated 2 years ago
• huggingface / fuego
  [WIP] A 🔥 interface for running code in the cloud
  ☆85Updated 2 years ago
• keerthanpg / DadJokeGenerator
  ☆46Updated 2 years ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆101Updated last year
• CarperAI / treasure_trove
  ☆22Updated last year
• Birch-san / llama-play
  Command-line script for inferencing from models such as LLaMA, in a chat scenario, with LoRA adaptations
  ☆33Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆46Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated last year
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• labmlai / neox
  Simple Annotated implementation of GPT-NeoX in PyTorch
  ☆110Updated 2 years ago
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated 2 years ago
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆114Updated 2 years ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year
• leehanchung / lora-instruct
  Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA
  ☆103Updated 2 weeks ago
• closedai-project / closedai
  Drop in replacement for OpenAI, but with Open models.
  ☆152Updated 2 years ago
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 2 years ago
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆178Updated last year
• teknium1 / stanford_alpaca-replit
  Modified Stanford-Alpaca Trainer for Training Replit's Code Model
  ☆40Updated 2 years ago
• LAION-AI / interesting-text-datasets
  ☆43Updated 2 years ago
• huu4ontocord / MDEL
  Multi-Domain Expert Learning
  ☆66Updated last year
• aspctu / alpaca-lora
  Instruct-tuning LLaMA on consumer hardware
  ☆65Updated 2 years ago
• abacaj / train-with-fsdp
  ☆92Updated last year
• CarperAI / cheese
  Used for adaptive human in the loop evaluation of language and embedding models.
  ☆308Updated 2 years ago
• JD-P / minihf
  MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…
  ☆172Updated last week