zsc / llama_inferLinks
Inference script for Meta's LLaMA models using Hugging Face wrapper
☆110Updated 2 years ago
Alternatives and similar repositories for llama_infer
Users that are interested in llama_infer are comparing it to the libraries listed below
Sorting:
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆209Updated last year
- ☆180Updated 2 years ago
- An Experiment on Dynamic NTK Scaling RoPE☆64Updated last year
- ☆98Updated 2 years ago
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆94Updated 2 years ago
- ☆104Updated 2 years ago
- Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI☆56Updated 2 years ago
- [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM☆186Updated 7 months ago
- Unofficial implementation of AlpaGasus☆92Updated last year
- Reverse Instructions to generate instruction tuning data with corpus examples☆215Updated last year
- Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese…☆130Updated 2 years ago
- Code for ACL2023 paper: Pre-Training to Learn in Context☆107Updated last year
- [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following☆78Updated last year
- A Multilingual Replicable Instruction-Following Model☆95Updated 2 years ago
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆116Updated 2 years ago
- An experimental implementation of the retrieval-enhanced language model☆76Updated 2 years ago
- A dataset for training/evaluating Question Answering Retrieval models on ChatGPT responses with the possibility to training/evaluating on…☆141Updated last year
- Plug in and play implementation of " Textbooks Are All You Need", ready for training, inference, and dataset generation☆74Updated last year
- This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…☆97Updated last year
- ☆72Updated 2 years ago
- [TMLR'23] Contrastive Search Is What You Need For Neural Text Generation☆121Updated 2 years ago
- The aim of this repository is to utilize LLaMA to reproduce and enhance the Stanford Alpaca☆98Updated 2 years ago
- a Fine-tuned LLaMA that is Good at Arithmetic Tasks☆177Updated last year
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆40Updated 10 months ago
- Experiments with generating opensource language model assistants☆97Updated 2 years ago
- The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective☆62Updated 2 years ago
- Transformers at any scale☆41Updated last year
- The code of paper "Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation" published at NeurIPS 202…☆47Updated 2 years ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆137Updated 2 years ago
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆84Updated last year