Alternatives and similar repositories for allamo:

Users that are interested in allamo are comparing it to the libraries listed below

• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• epfml / landmark-attention
  Landmark Attention: Random-Access Infinite Context Length for Transformers
  ☆421Updated last year
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆77Updated 11 months ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆158Updated last year
• zphang / minimal-llama
  ☆457Updated last year
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆147Updated last year
• rmihaylov / falcontune
  Tune any FALCON in 4-bit
  ☆466Updated last year
• iwalton3 / mpt-lora-patch
  Patch for MPT-7B which allows using and training a LoRA
  ☆58Updated last year
• johnsmith0031 / alpaca_lora_4bit
  ☆536Updated last year
• uukuguy / multi_loras
  Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…
  ☆150Updated last year
• jondurbin / bagel
  A bagel, with everything.
  ☆317Updated 11 months ago
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆73Updated last year
• alasdairforsythe / tokenmonster
  Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript
  ☆574Updated 8 months ago
• rmihaylov / mpttune
  Tune MPTs
  ☆84Updated last year
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 6 months ago
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆205Updated 7 months ago
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆31Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆171Updated 10 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated last year
• clcarwin / alpaca-weight
  Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.
  ☆50Updated last year
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆99Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated last year
• declare-lab / flan-alpaca
  This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as…
  ☆351Updated last year
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆111Updated last year
• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆448Updated 11 months ago
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated 2 years ago