okuvshynov / slowllama
Finetune llama2-70b and codellama on MacBook Air without quantization
☆448Updated 11 months ago
Alternatives and similar repositories for slowllama:
Users that are interested in slowllama are comparing it to the libraries listed below
- Visualize the intermediate output of Mistral 7B☆344Updated 2 months ago
- Enforce structured output from LLMs 100% of the time☆248Updated 8 months ago
- JS tokenizer for LLaMA 1 and 2☆350Updated 8 months ago
- Complex LLM Workflows from Simple JSON.☆293Updated last year
- OpenAI-compatible Python client that can call any LLM☆371Updated last year
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆853Updated last year
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆324Updated last year
- Fine-tune LLM agents with online reinforcement learning☆1,094Updated last year
- LLM Analytics☆646Updated 5 months ago
- Agents Capable of Self-Editing Their Prompts / Python Code☆759Updated last year
- C++ implementation for 💫StarCoder☆453Updated last year
- Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework☆339Updated 3 months ago
- Prompt engineering for developers☆678Updated last year
- A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…☆1,009Updated 3 weeks ago
- A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…☆601Updated 3 months ago
- Large language model evaluation and workflow framework from Phase AI.☆457Updated 2 months ago
- ☆111Updated last month
- Instruct-tune LLaMA on consumer hardware☆362Updated last year
- Fork of Facebooks LLaMa model to run on CPU☆773Updated 2 years ago
- Action library for AI Agent☆211Updated this week
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆728Updated this week
- LLMFlows - Simple, Explicit and Transparent LLM Apps☆689Updated last month
- Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.☆274Updated last week
- LLM plugin for running models using MLC☆184Updated 11 months ago
- a small code base for training large models☆288Updated 3 months ago
- Finetune a LLM to speak like you based on your WhatsApp Conversations☆359Updated 10 months ago
- llama3.np is a pure NumPy implementation for Llama 3 model.☆974Updated 9 months ago
- Constrained Decoding for LLMs against JSON Schema☆326Updated last year
- Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)☆566Updated last year
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆279Updated last month