Finetune llama2-70b and codellama on MacBook Air without quantization
☆446Mar 28, 2024Updated 2 years ago
Alternatives and similar repositories for slowllama
Users that are interested in slowllama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Llama 2 Everywhere (L2E)☆1,521Aug 27, 2025Updated last year
- Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.☆870Oct 22, 2026Updated last week
- Seamlessly integrate LLMs as Python functions☆2,428Mar 11, 2026Updated 7 months ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,646Mar 4, 2026Updated 7 months ago
- Turn expensive prompts into cheap fine-tuned models☆2,836May 25, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Experimentation with Streamlit for personal LLM tool☆15Jun 19, 2023Updated 3 years ago
- Simple UI for LLM Model Finetuning☆2,052Dec 21, 2023Updated 2 years ago
- A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…☆1,052Feb 27, 2025Updated last year
- A simple "Be My Eyes" web app with a llama.cpp/llava backend☆497Nov 28, 2023Updated 2 years ago
- DataDM is your private data assistant. Slide into your data's DMs☆385Oct 6, 2024Updated 2 years ago
- Self-improving Agents☆823Mar 15, 2024Updated 2 years ago
- An extensible, easy-to-use, and portable diffusion web UI 👨🎨☆1,670Aug 18, 2023Updated 3 years ago
- ☆3,333Feb 25, 2024Updated 2 years ago
- Distribute and run LLMs with a single file.☆26,520Oct 12, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but…☆2,089Jun 18, 2026Updated 4 months ago
- AI-to-AI Testing | Simulation framework for LLM-based applications☆138Nov 7, 2023Updated 2 years ago
- A toolkit for applying LLMs to sensitive, non-public data in offline or restricted environments☆845Oct 23, 2026Updated last week
- Flacuna was developed by fine-tuning Vicuna on Flan-mini, a comprehensive instruction collection encompassing various tasks. Vicuna is al…☆112Sep 10, 2023Updated 3 years ago
- Generative AutoML for Tabular Data☆446Oct 5, 2026Updated 3 weeks ago
- Nearby NYC Citibike Stations via SMS☆11Oct 18, 2025Updated last year
- Create and share easy-to-make, built-to-last, innovative, and customizable experiences☆34Feb 21, 2024Updated 2 years ago
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆10,672Sep 7, 2024Updated 2 years ago
- Examples in the MLX framework☆9,040Apr 6, 2026Updated 6 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Count Tokens of Code (forked from gocloc)☆44Aug 19, 2024Updated 2 years ago
- Fine-tune LLM agents with online reinforcement learning☆1,253Mar 19, 2024Updated 2 years ago
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,082Jul 1, 2025Updated last year
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆7,273Jul 11, 2024Updated 2 years ago
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,469Jun 7, 2025Updated last year
- An LLM-powered advanced RAG pipeline built from scratch☆855Jan 26, 2024Updated 2 years ago
- ☆1,275Oct 24, 2023Updated 3 years ago
- 💭 Chat with AI via API☆32Oct 20, 2024Updated 2 years ago
- Structured Outputs☆15,989Sep 21, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.☆4,120Jan 8, 2025Updated last year
- Running large language models on a single GPU for throughput-oriented scenarios.☆9,343Oct 28, 2024Updated 2 years ago
- Fork of Facebooks LLaMa model to run on CPU☆766Mar 6, 2023Updated 3 years ago
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆868Jan 15, 2024Updated 2 years ago
- Universal LLM Deployment Engine with ML Compilation☆23,285Updated this week
- AI-managed code blocks in Python ⏪⏩☆464Oct 5, 2023Updated 3 years ago
- A comprehensive guide to building RAG-based LLM applications for production.☆1,863Aug 15, 2026Updated 2 months ago