chrisociepa / allamo

Related projects ⓘ

Alternatives and complementary repositories for allamo

• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated last year
• rmihaylov / falcontune
  Tune any FALCON in 4-bit
  ☆468Updated last year
• johnsmith0031 / alpaca_lora_4bit
  ☆534Updated 11 months ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 2 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers model
  ☆162Updated 6 months ago
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆77Updated 7 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆244Updated 9 months ago
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆111Updated last year
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆232Updated 5 months ago
• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆435Updated 6 months ago
• rmihaylov / mpttune
  Tune MPTs
  ☆84Updated last year
• iwalton3 / mpt-lora-patch
  Patch for MPT-7B which allows using and training a LoRA
  ☆58Updated last year
• mzbac / qlora-fine-tune
  ☆168Updated last year
• alasdairforsythe / tokenmonster
  Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript
  ☆551Updated 4 months ago
• epfml / landmark-attention
  Landmark Attention: Random-Access Infinite Context Length for Transformers
  ☆415Updated 11 months ago
• uukuguy / multi_loras
  Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…
  ☆142Updated 9 months ago
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆312Updated 11 months ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆155Updated last year
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆145Updated last year
• iantbutler01 / rwkv-raven-qlora-4bit-instruct
  A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
  ☆28Updated 5 months ago
• Preemo-Inc / text-generation-inference
  ☆200Updated 9 months ago
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆201Updated 3 months ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated 9 months ago
• NouamaneTazi / bloomz.cpp
  C++ implementation for BLOOM
  ☆811Updated last year
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated last year
• SkunkworksAI / hydra-moe
  ☆411Updated last year
• mobarski / alpaca-libre
  Reimplementation of the task generation part from the Alpaca paper
  ☆119Updated last year
• zphang / minimal-llama
  ☆454Updated last year
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆407Updated last year
• thomasantony / llamacpp-python
  Python bindings for llama.cpp
  ☆199Updated last year