remixer-dec / llama-mpsLinks
Experimental fork of Facebooks LLaMa model which runs it with GPU acceleration on Apple Silicon M1/M2
☆86Updated 2 years ago
Alternatives and similar repositories for llama-mps
Users that are interested in llama-mps are comparing it to the libraries listed below
Sorting:
- LLM plugin for running models using MLC☆191Updated last year
- Tiny inference-only implementation of LLaMA☆92Updated last year
- Revealing example of self-attention, the building block of transformer AI models☆131Updated 2 years ago
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆323Updated 2 years ago
- Augment GPT-4 Environment Access☆285Updated 2 years ago
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- Instruct-tune LLaMA on consumer hardware☆362Updated 2 years ago
- GPT-3 on your command line☆130Updated 2 years ago
- Code repo for "Most Language Models can be Poets too: An AI Writing Assistant and Constrained Text Generation Studio" at the (CAI2) wor…☆212Updated 2 years ago
- An implementation of bucketMul LLM inference☆222Updated last year
- Implement recursion using English as the programming language and an LLM as the runtime.☆238Updated 2 years ago
- WebGPU LLM inference tuned by hand☆151Updated 2 years ago
- Enforce structured output from LLMs 100% of the time☆248Updated last year
- Inference code for LLaMA models☆189Updated 2 years ago
- ☆254Updated 2 years ago
- Extend the original llama.cpp repo to support redpajama model.☆118Updated last year
- Demos utilizing the ChatGPT API☆94Updated 2 years ago
- Finetune llama2-70b and codellama on MacBook Air without quantization☆450Updated last year
- Python notebook to run OpenAI's Whisper model with speaker identification☆80Updated 3 years ago
- JS tokenizer for LLaMA 1 and 2☆362Updated last year
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆161Updated 2 years ago
- Port of Facebook's LLaMA model in C/C++☆45Updated 2 years ago
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆158Updated 2 years ago
- Your friendly terminal-based AI pair programmer☆41Updated 2 years ago
- Supercharge Open-Source AI Models☆349Updated 2 years ago
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆141Updated last year
- Text generator prompting with Boolean operators☆181Updated 3 weeks ago
- automatic sentence highlights based on their significance to the document☆196Updated 2 years ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆100Updated 2 years ago
- A web-app to explore topics using LLM (less typing and more clicks)☆67Updated last year