venuatu / llama
Inference code for LLaMA models
☆46Updated 2 years ago
Alternatives and similar repositories for llama:
Users that are interested in llama are comparing it to the libraries listed below
- Inference code for LLaMA models☆35Updated 2 years ago
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆111Updated last year
- Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.☆51Updated last year
- Inference code for facebook LLaMA models with Wrapyfi support☆130Updated 2 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- Inference code for LLaMA models☆188Updated 2 years ago
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆31Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆246Updated last year
- Framework agnostic python runtime for RWKV models☆145Updated last year
- 4 bits quantization of SantaCoder using GPTQ☆51Updated last year
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆324Updated 2 years ago
- Extend the original llama.cpp repo to support redpajama model.☆117Updated 6 months ago
- ☆535Updated last year
- ☆40Updated 2 years ago
- SoTA Transformers with C-backend for fast inference on your CPU.☆311Updated last year
- Inference code for LLaMA 2 models☆30Updated 8 months ago
- Inference code for LLaMA models with Gradio Interface and rolling generation like ChatGPT☆48Updated 2 years ago
- Instruct-tuning LLaMA on consumer hardware☆66Updated 2 years ago
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆111Updated 2 years ago
- C++ implementation for 💫StarCoder☆453Updated last year
- ☆458Updated last year
- ☆405Updated 2 years ago
- LLM-based code completion engine☆181Updated 2 months ago
- Embeddings focused small version of Llama NLP model☆103Updated last year
- GPT-2 small trained on phi-like data☆65Updated last year
- LLaVA server (llama.cpp).☆179Updated last year
- Instruct-tune LLaMA on consumer hardware☆73Updated last year
- Simple, hackable and fast implementation for training/finetuning medium-sized LLaMA-based models☆165Updated this week
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆65Updated last year
- LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.☆122Updated last year