e-p-armstrong / augmentoolkit
Convert Compute And Books Into Instruct-Tuning Datasets! Makes: QA, RP, Classifiers.
☆1,314Updated last week
Alternatives and similar repositories for augmentoolkit:
Users that are interested in augmentoolkit are comparing it to the libraries listed below
- Optimizing inference proxy for LLMs☆2,047Updated this week
- Large-scale LLM inference engine☆1,295Updated this week
- ☆810Updated 5 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,448Updated this week
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆541Updated 3 months ago
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆927Updated 3 weeks ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆3,635Updated 6 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆530Updated this week
- A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data☆1,384Updated 2 weeks ago
- Simple Python library/structure to ablate features in LLMs which are supported by TransformerLens☆416Updated 8 months ago
- Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali☆1,816Updated last week
- Build datasets using natural language☆368Updated this week
- What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …☆513Updated last week
- Curated list of datasets and tools for post-training.☆2,698Updated 3 weeks ago
- An OAI compatible exllamav2 API that's both lightweight and fast☆795Updated this week
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆734Updated 3 weeks ago
- Everything about the SmolLM2 and SmolVLM family of models☆1,888Updated 2 weeks ago
- LLM for Long Text Summary (Comprehensive Bulleted Notes)☆497Updated last month
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆2,362Updated last week
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆647Updated last month
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,708Updated this week
- Generic rag framework to apply the power of LLMs on any given dataset☆525Updated this week
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆1,030Updated last month
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆740Updated last week
- A community-driven collection of RAG (Retrieval-Augmented Generation) frameworks, projects, and resources. Contribute and explore the evo…☆562Updated last week
- multi1: create o1-like reasoning chains with multiple AI providers (and locally). Supports LiteLLM as backend too for 100+ providers at o…☆345Updated 3 weeks ago
- An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.☆552Updated last month
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆173Updated 7 months ago
- 👩🏻🍳 A collection of example notebooks☆428Updated last week
- An Open Source Toolkit For LLM Distillation☆499Updated last month