Alternatives and similar repositories for transformers:

Users that are interested in transformers are comparing it to the libraries listed below

• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆111Updated last year
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆208Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆66Updated 3 months ago
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆62Updated last year
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆90Updated last year
• vihangd / alpaca-qlora
  Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA
  ☆80Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated last year
• AI21Labs / Parallel-Context-Windows
  ☆106Updated last year
• young-geng / koala_data_pipeline
  The data processing pipeline for the Koala chatbot language model
  ☆117Updated last year
• 18907305772 / FuseAI
  FuseAI Project
  ☆80Updated this week
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆76Updated last year
• swj0419 / detect-pretrain-code-contamination
  ☆74Updated last year
• GeneZC / MiniMA
  Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"
  ☆97Updated 6 months ago
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆89Updated last year
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆99Updated last year
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆204Updated 8 months ago
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆70Updated last year
• orhonovich / unnatural-instructions
  ☆177Updated last year
• LowinLi / transformers-stream-generator
  This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…
  ☆96Updated 10 months ago
• lxe / llama-tune
  LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers
  ☆50Updated last year
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆213Updated last year
• LLM360 / amber-train
  Pre-training code for Amber 7B LLM
  ☆160Updated 8 months ago
• raunak-agarwal / instruction-datasets
  All available datasets for Instruction Tuning of Large Language Models
  ☆241Updated last year
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆123Updated last year
• liutiedong / goat
  a Fine-tuned LLaMA that is Good at Arithmetic Tasks
  ☆177Updated last year
• OpenBMB / DecT
  Source code for ACL 2023 paper Decoder Tuning: Efficient Language Understanding as Decoding
  ☆48Updated last year
• Dahoas / reward-modeling
  ☆96Updated last year
• dropreg / efficient_alpaca
  The aim of this repository is to utilize LLaMA to reproduce and enhance the Stanford Alpaca
  ☆96Updated last year
• jshuadvd / LongRoPE
  Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
  ☆125Updated 6 months ago
• OpenLMLab / LEval
  [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark
  ☆369Updated 6 months ago