Alternatives and similar repositories for transformers

Users that are interested in transformers are comparing it to the libraries listed below

• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated 2 years ago
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆64Updated last year
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆209Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆90Updated last year
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year
• Dahoas / reward-modeling
  ☆96Updated 2 years ago
• orhonovich / unnatural-instructions
  ☆179Updated 2 years ago
• LLM360 / amber-train
  Pre-training code for Amber 7B LLM
  ☆166Updated last year
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆126Updated last year
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆78Updated last year
• AI21Labs / Parallel-Context-Windows
  ☆105Updated last year
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Updated last year
• uukuguy / multi_loras
  Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…
  ☆151Updated last year
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆188Updated 9 months ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆202Updated last year
• jshuadvd / LongRoPE
  Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
  ☆136Updated 10 months ago
• LowinLi / transformers-stream-generator
  This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…
  ☆95Updated last year
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆78Updated last year
• young-geng / koala_data_pipeline
  The data processing pipeline for the Koala chatbot language model
  ☆117Updated 2 years ago
• liutiedong / goat
  a Fine-tuned LLaMA that is Good at Arithmetic Tasks
  ☆178Updated last year
• GeneZC / MiniMA
  Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"
  ☆100Updated 10 months ago
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆91Updated last year
• lxe / llama-tune
  LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers
  ☆51Updated 2 years ago
• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated 4 months ago
• RWKV-Wiki / MultilingualShareGPT
  MultilingualShareGPT, the free multi-language corpus for LLM training
  ☆72Updated 2 years ago
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆89Updated last year
• Digitous / LLM-SLERP-Merge
  Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
  ☆123Updated last year
• swj0419 / detect-pretrain-code-contamination
  ☆76Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆114Updated 2 years ago
• nlpxucan / evol-instruct
  ☆269Updated 2 years ago