gmorenz / llama
Inference code for LLaMA models
☆35Updated last year
Related projects: ⓘ
- Inference code for LLaMA models☆45Updated last year
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆30Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Updated last year
- LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.☆109Updated last year
- Inference code for LLaMA models☆189Updated last year
- Inference code for LLaMA 2 models☆30Updated 2 months ago
- ☆22Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- A collection of prompts for Llama☆94Updated last year
- A library for incremental loading of large PyTorch checkpoints☆56Updated last year
- The code we currently use to fine-tune models.☆107Updated 4 months ago
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆34Updated last year
- Command-line script for inferencing from models such as falcon-7b-instruct☆75Updated last year
- GPT-2 small trained on phi-like data☆65Updated 7 months ago
- Extend the original llama.cpp repo to support redpajama model.☆117Updated 2 weeks ago
- ☆12Updated this week
- 4 bits quantization of SantaCoder using GPTQ☆54Updated last year
- An OpenAI-like LLaMA inference API☆111Updated last year
- Inference code for facebook LLaMA models with Wrapyfi support☆130Updated last year
- Command-line script for inferencing from models such as MPT-7B-Chat☆102Updated last year
- rwkv_chatbot☆61Updated last year
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆91Updated last year
- ☆40Updated last year
- Instruct-tuning LLaMA on consumer hardware☆66Updated last year
- ☆53Updated last year
- A cog implementation of MosaicML's MPT-7B-StoryWriter-65k+ Large Language Model☆56Updated last year
- An unsupervised model merging algorithm for Transformers-based language models.☆96Updated 4 months ago
- GRDN.AI app for garden optimization☆68Updated 7 months ago
- A prompt/context management system☆163Updated last year
- Python examples using the bigcode/tiny_starcoder_py 159M model to generate code☆43Updated last year