remixer-dec / llama-mpsLinks
Experimental fork of Facebooks LLaMa model which runs it with GPU acceleration on Apple Silicon M1/M2
☆86Updated 2 years ago
Alternatives and similar repositories for llama-mps
Users that are interested in llama-mps are comparing it to the libraries listed below
Sorting:
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆324Updated 2 years ago
- LLM plugin for running models using MLC☆191Updated last year
- Tiny inference-only implementation of LLaMA☆93Updated last year
- Code repo for "Most Language Models can be Poets too: An AI Writing Assistant and Constrained Text Generation Studio" at the (CAI2) wor…☆212Updated 2 years ago
- Augment GPT-4 Environment Access☆285Updated 2 years ago
- Revealing example of self-attention, the building block of transformer AI models☆131Updated 2 years ago
- Inference code for LLaMA models☆189Updated 2 years ago
- An implementation of bucketMul LLM inference☆223Updated last year
- GPT-3 on your command line☆131Updated 2 years ago
- WebGPU LLM inference tuned by hand☆151Updated 2 years ago
- JS tokenizer for LLaMA 1 and 2☆357Updated last year
- Extend the original llama.cpp repo to support redpajama model.☆118Updated 11 months ago
- ☆254Updated 2 years ago
- Array-Inspired Pipeline Language☆120Updated last year
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- Falcon LLM ggml framework with CPU and GPU support☆247Updated last year
- Stop messing around with finicky sampling parameters and just use DRµGS!☆356Updated last year
- Enforce structured output from LLMs 100% of the time☆250Updated last year
- Text generator prompting with Boolean operators☆178Updated 2 years ago
- Implement recursion using English as the programming language and an LLM as the runtime.☆239Updated 2 years ago
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆140Updated last year
- Instruct-tune LLaMA on consumer hardware☆362Updated 2 years ago
- Finetune llama2-70b and codellama on MacBook Air without quantization☆448Updated last year
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆156Updated 2 years ago
- A web-app to explore topics using LLM (less typing and more clicks)☆67Updated last year
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆161Updated 2 years ago
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆110Updated 2 years ago
- Modified Stanford-Alpaca Trainer for Training Replit's Code Model☆41Updated 2 years ago
- Tensor library for machine learning☆275Updated 2 years ago
- SoTA Transformers with C-backend for fast inference on your CPU.☆309Updated last year