unslothai / unsloth
Finetune Llama 4, DeepSeek-R1, Gemma 3 & Reasoning LLMs 2x faster with 70% less memory! 🦥
☆36,949Updated this week
Alternatives and similar repositories for unsloth:
Users that are interested in unsloth are comparing it to the libraries listed below
- A high-throughput and memory-efficient inference and serving engine for LLMs☆44,418Updated this week
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆46,385Updated this week
- SGLang is a fast serving framework for large language models and vision language models.☆13,051Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆19,569Updated last month
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆24,383Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆20,383Updated this week
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆16,993Updated this week
- The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.☆17,777Updated 2 weeks ago
- Qwen2.5 is the large language model series developed by Qwen team, Alibaba Cloud.☆16,593Updated 3 weeks ago
- Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.☆15,854Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆40,761Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆11,948Updated this week
- The official Meta Llama 3 GitHub site☆28,604Updated 2 months ago
- LLM inference in C/C++☆77,955Updated this week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆38,364Updated 2 weeks ago
- LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.☆20,786Updated this week
- Inference code for Llama models☆58,078Updated 2 months ago
- Go ahead and axolotl questions☆9,023Updated this week
- DSPy: The framework for programming—not prompting—language models☆23,167Updated this week
- Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.☆136,553Updated this week
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆34,783Updated this week
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆14,058Updated 3 weeks ago
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.☆42,577Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆88,841Updated this week
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆42,889Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,098Updated this week
- Retrieval and Retrieval-augmented LLMs☆9,296Updated this week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆21,269Updated this week
- The Memory layer for AI Agents☆27,435Updated this week
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆18,082Updated this week