okuvshynov / slowllamaLinks
Finetune llama2-70b and codellama on MacBook Air without quantization
☆447Updated last year
Alternatives and similar repositories for slowllama
Users that are interested in slowllama are comparing it to the libraries listed below
Sorting:
- JS tokenizer for LLaMA 1 and 2☆353Updated 11 months ago
- Visualize the intermediate output of Mistral 7B☆367Updated 5 months ago
- A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…☆1,017Updated 3 months ago
- LLM Analytics☆668Updated 8 months ago
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆857Updated last year
- C++ implementation for 💫StarCoder☆453Updated last year
- Complex LLM Workflows from Simple JSON.☆304Updated last year
- Agents Capable of Self-Editing Their Prompts / Python Code☆768Updated last year
- clean & curate your data with LLMs.☆493Updated last year
- Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)☆567Updated last year
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆325Updated 2 years ago
- An implementation of bucketMul LLM inference☆217Updated 11 months ago
- Finetune ALL LLMs with ALL Adapeters on ALL Platforms!☆319Updated this week
- Large language model evaluation and workflow framework from Phase AI.☆456Updated 5 months ago
- fast vector database made in numpy☆748Updated last year
- Fine-tune mistral-7B on 3090s, a100s, h100s☆714Updated last year
- OpenAI-compatible Python client that can call any LLM☆371Updated 2 years ago
- llama3.np is a pure NumPy implementation for Llama 3 model.☆984Updated 2 months ago
- Constrained Decoding for LLMs against JSON Schema☆327Updated 2 years ago
- Stop messing around with finicky sampling parameters and just use DRµGS!☆349Updated last year
- A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…☆616Updated 3 months ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆285Updated 3 weeks ago
- Prompt engineering for developers☆686Updated last year
- A school for camelids☆1,209Updated 2 years ago
- Enforce structured output from LLMs 100% of the time☆249Updated 11 months ago
- A simple "Be My Eyes" web app with a llama.cpp/llava backend☆490Updated last year
- Finetune a LLM to speak like you based on your WhatsApp Conversations☆364Updated last year
- ☆415Updated last year
- Extend the original llama.cpp repo to support redpajama model.☆118Updated 9 months ago
- Inference code for Persimmon-8B☆415Updated last year