zsc / llama_infer
Inference script for Meta's LLaMA models using Hugging Face wrapper
☆110Updated 2 years ago
Alternatives and similar repositories for llama_infer:
Users that are interested in llama_infer are comparing it to the libraries listed below
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆208Updated last year
- ☆106Updated last year
- An Experiment on Dynamic NTK Scaling RoPE☆64Updated last year
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆90Updated last year
- Unofficial implementation of AlpaGasus☆91Updated last year
- ☆97Updated last year
- Pipeline for pulling and processing online language model pretraining data from the web☆177Updated last year
- Techniques used to run BLOOM at inference in parallel☆37Updated 2 years ago
- Reverse Instructions to generate instruction tuning data with corpus examples☆209Updated last year
- A Multilingual Replicable Instruction-Following Model☆93Updated last year
- Code for ACL2023 paper: Pre-Training to Learn in Context☆108Updated 9 months ago
- Experiments with generating opensource language model assistants☆97Updated last year
- [TMLR'23] Contrastive Search Is What You Need For Neural Text Generation☆119Updated 2 years ago
- ☆72Updated last year
- Code and models for BERT on STILTs☆53Updated 2 years ago
- Transformers at any scale☆41Updated last year
- ☆179Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)☆157Updated 2 years ago
- [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following☆79Updated 7 months ago
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆115Updated 2 years ago
- Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA☆81Updated last year
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆180Updated 2 years ago
- ☆97Updated 2 years ago
- [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM☆186Updated 3 months ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆76Updated last year
- Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese…☆124Updated last year
- The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…☆176Updated 4 months ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆69Updated last year
- LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers☆51Updated 2 years ago