Alternatives and similar repositories for llama_infer

Users that are interested in llama_infer are comparing it to the libraries listed below

• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆209Updated last year
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆64Updated last year
• Dahoas / reward-modeling
  ☆96Updated 2 years ago
• AI21Labs / Parallel-Context-Windows
  ☆104Updated 2 years ago
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆92Updated last year
• orhonovich / unnatural-instructions
  ☆180Updated 2 years ago
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆57Updated last year
• gmftbyGMFTBY / Copyisallyouneed
  [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM
  ☆186Updated 5 months ago
• thu-coai / PICL
  Code for ACL2023 paper: Pre-Training to Learn in Context
  ☆107Updated 11 months ago
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆116Updated 2 years ago
• shjwudp / c4-dataset-script
  Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese…
  ☆127Updated 2 years ago
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆214Updated last year
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆93Updated last year
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆178Updated last year
• kyegomez / phi-1
  Plug in and play implementation of " Textbooks Are All You Need", ready for training, inference, and dataset generation
  ☆76Updated last year
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆94Updated 2 years ago
• GeneZC / MiniMA
  Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"
  ☆99Updated last year
• shayne-longpre / a-pretrainers-guide
  ☆72Updated 2 years ago
• yxuansu / Contrastive_Search_Is_What_You_Need
  [TMLR'23] Contrastive Search Is What You Need For Neural Text Generation
  ☆119Updated 2 years ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 10 months ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆79Updated last year
• dropreg / efficient_alpaca
  The aim of this repository is to utilize LLaMA to reproduce and enhance the Stanford Alpaca
  ☆97Updated 2 years ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆180Updated 2 years ago
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆194Updated 11 months ago
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆41Updated 8 months ago
• Langboat / mengzi-retrieval-lm
  An experimental implementation of the retrieval-enhanced language model
  ☆74Updated 2 years ago
• EleutherAI / stackexchange-dataset
  Python tools for processing the stackexchange data dumps into a text dataset for Language Models
  ☆82Updated last year
• liutiedong / goat
  a Fine-tuned LLaMA that is Good at Arithmetic Tasks
  ☆178Updated last year