Alternatives and similar repositories for easy-lora-and-gptq:

Users that are interested in easy-lora-and-gptq are comparing it to the libraries listed below

• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆48Updated last year
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated 2 years ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆36Updated last year
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 5 months ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆36Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆83Updated last month
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆36Updated last year
• euclaise / supertrainer2000
  ☆49Updated last year
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated last year
• epfml / DenseFormer
  ☆79Updated 11 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆47Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆80Updated 3 years ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year
• abacaj / train-with-fsdp
  ☆92Updated last year
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆46Updated last year
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆79Updated 3 months ago
• cloneofsimo / min-fsdp
  ☆76Updated 8 months ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆81Updated last year
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 2 years ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• ChrisHayduk / QLoRA-for-MLM
  QLoRA for Masked Language Modeling
  ☆21Updated last year
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆31Updated 7 months ago
• TristanThrush / i-am-a-strange-dataset
  Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"
  ☆41Updated last year
• cat-state / tinypar
  ☆20Updated last year
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆131Updated 10 months ago