okuvshynov / slowllama
Finetune llama2-70b and codellama on MacBook Air without quantization
☆448Updated last year
Alternatives and similar repositories for slowllama:
Users that are interested in slowllama are comparing it to the libraries listed below
- Visualize the intermediate output of Mistral 7B☆357Updated 3 months ago
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆854Updated last year
- Agents Capable of Self-Editing Their Prompts / Python Code☆763Updated last year
- JS tokenizer for LLaMA 1 and 2☆351Updated 9 months ago
- Complex LLM Workflows from Simple JSON.☆297Updated last year
- LLaMa retrieval plugin script using OpenAI's retrieval plugin☆324Updated 2 years ago
- Prompt engineering for developers☆687Updated last year
- Enforce structured output from LLMs 100% of the time☆249Updated 9 months ago
- Fine-tune mistral-7B on 3090s, a100s, h100s☆710Updated last year
- A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…☆609Updated last month
- Instruct-tune LLaMA on consumer hardware☆362Updated 2 years ago
- Finetune a LLM to speak like you based on your WhatsApp Conversations☆362Updated 11 months ago
- A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…☆1,015Updated last month
- LLM Analytics☆655Updated 6 months ago
- llama3.np is a pure NumPy implementation for Llama 3 model.☆981Updated 10 months ago
- Constrained Decoding for LLMs against JSON Schema☆326Updated last year
- ☆742Updated last year
- Action library for AI Agent☆214Updated 3 weeks ago
- A BERT that you can train on a (gaming) laptop.☆208Updated last year
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆282Updated last week
- An implementation of bucketMul LLM inference☆216Updated 9 months ago
- OpenAI-compatible Python client that can call any LLM☆370Updated last year
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆744Updated this week
- Large language model evaluation and workflow framework from Phase AI.☆457Updated 3 months ago
- fast vector database made in numpy☆751Updated 11 months ago
- Fine-tune LLM agents with online reinforcement learning☆1,108Updated last year
- LLM plugin for running models using MLC☆186Updated last year
- ☆412Updated last year
- LLMFlows - Simple, Explicit and Transparent LLM Apps☆692Updated 2 months ago
- 🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and mo…☆1,029Updated 3 months ago