okuvshynov / slowllamaLinks
Finetune llama2-70b and codellama on MacBook Air without quantization
☆448Updated last year
Alternatives and similar repositories for slowllama
Users that are interested in slowllama are comparing it to the libraries listed below
Sorting:
- JS tokenizer for LLaMA 1 and 2☆357Updated last year
- LLM Analytics☆677Updated 10 months ago
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆860Updated last year
- Finetune a LLM to speak like you based on your WhatsApp Conversations☆369Updated last year
- Agents Capable of Self-Editing Their Prompts / Python Code☆772Updated last year
- OpenAI-compatible Python client that can call any LLM☆372Updated 2 years ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆286Updated 3 weeks ago
- Prompt engineering for developers☆690Updated last year
- A simple "Be My Eyes" web app with a llama.cpp/llava backend☆491Updated last year
- A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…☆622Updated 5 months ago
- Visualize the intermediate output of Mistral 7B☆368Updated 7 months ago
- An implementation of bucketMul LLM inference☆223Updated last year
- A toolkit for applying on-premises large language models to non-public data☆742Updated this week
- A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…☆1,023Updated 6 months ago
- Complex LLM Workflows from Simple JSON.☆311Updated 2 years ago
- Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset☆259Updated last year
- Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework☆342Updated 9 months ago
- Instruct-tune LLaMA on consumer hardware☆362Updated 2 years ago
- ☆116Updated 6 months ago
- Enforce structured output from LLMs 100% of the time☆250Updated last year
- Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.☆279Updated this week
- Constrained Decoding for LLMs against JSON Schema☆329Updated 2 years ago
- DataDM is your private data assistant. Slide into your data's DMs☆386Updated 10 months ago
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆324Updated 2 years ago
- llama3.np is a pure NumPy implementation for Llama 3 model.☆988Updated 4 months ago
- An LLM-powered advanced RAG pipeline built from scratch☆847Updated last year
- Fine-tune mistral-7B on 3090s, a100s, h100s☆719Updated last year
- LLMFlows - Simple, Explicit and Transparent LLM Apps☆699Updated 6 months ago
- Large language model evaluation and workflow framework from Phase AI.☆458Updated 7 months ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆220Updated 8 months ago