remixer-dec / llama-mps
Experimental fork of Facebooks LLaMa model which runs it with GPU acceleration on Apple Silicon M1/M2
☆87Updated last year
Related projects ⓘ
Alternatives and complementary repositories for llama-mps
- Tiny inference-only implementation of LLaMA☆91Updated 7 months ago
- A library for incremental loading of large PyTorch checkpoints☆56Updated last year
- Implement recursion using English as the programming language and an LLM as the runtime.☆128Updated last year
- LLM plugin for running models using MLC☆180Updated 7 months ago
- Revealing example of self-attention, the building block of transformer AI models☆130Updated last year
- Extend the original llama.cpp repo to support redpajama model.☆117Updated 2 months ago
- A web-app to explore topics using LLM (less typing and more clicks)☆65Updated 10 months ago
- Augment GPT-4 Environment Access☆288Updated last year
- Converts JSON-Schema to GBNF grammar to use with llama.cpp☆51Updated 11 months ago
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆152Updated last year
- WebGPU LLM inference tuned by hand☆146Updated last year
- Hierarchical topic segmentation of meeting transcripts using embeddings and divisive clustering.☆50Updated 3 months ago
- Extensible AI assistant platform that bridges LLMs to tasks and actions☆38Updated last year
- Enforce structured output from LLMs 100% of the time☆241Updated 3 months ago
- A collection of prompts to challenge the reasoning abilities of large language models in presence of misguiding information☆94Updated this week
- ☆71Updated 7 months ago
- Text generator prompting with Boolean operators☆180Updated last year
- Command-line script for inferencing from models such as MPT-7B-Chat☆102Updated last year
- An implementation of bucketMul LLM inference☆214Updated 4 months ago
- a curated list of data for reasoning ai☆111Updated 3 months ago
- LLM plugin for clustering embeddings☆61Updated 8 months ago
- Visualize text embeddings☆33Updated last year
- GPT-3 on your command line☆132Updated last year
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆154Updated last year
- Use context-free grammars with an LLM☆162Updated 7 months ago
- LLM plugin providing access to Mistral models using the Mistral API☆149Updated last week
- ☆136Updated 11 months ago