e-p-armstrong / augmentoolkit
Convert Compute And Books Into Instruct-Tuning Datasets! Makes: QA, RP, Classifiers.
☆1,432Updated 2 months ago
Alternatives and similar repositories for augmentoolkit:
Users that are interested in augmentoolkit are comparing it to the libraries listed below
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,671Updated last week
- Optimizing inference proxy for LLMs☆2,210Updated this week
- Large-scale LLM inference engine☆1,405Updated last week
- ☆868Updated 7 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆582Updated 6 months ago
- A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data☆1,408Updated 2 weeks ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆2,965Updated this week
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,400Updated last month
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,078Updated 3 months ago
- Convenience scripts to finetune (chat-)LLaMa3 and other models for any language☆305Updated 10 months ago
- ☆645Updated last week
- Curated list of datasets and tools for post-training.☆3,002Updated 3 months ago
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆777Updated 3 months ago
- ☆1,666Updated last week
- Framework for enhancing LLMs for RAG tasks using fine-tuning.☆737Updated 2 months ago
- Generic rag framework to apply the power of LLMs on any given dataset☆600Updated this week
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆558Updated 2 months ago
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆726Updated 3 weeks ago
- High-performance retrieval engine for unstructured data☆1,373Updated this week
- ☆2,928Updated 7 months ago
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,426Updated 2 months ago
- An OAI compatible exllamav2 API that's both lightweight and fast☆940Updated this week
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,796Updated 2 months ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆3,884Updated 8 months ago
- Synthetic data curation for post-training and structured data extraction☆1,290Updated last week
- Efficient visual programming for AI language models☆359Updated 7 months ago
- openperplex is an opensource AI search engine☆855Updated 9 months ago
- function calling-based LLM agents☆285Updated 7 months ago
- Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.☆1,055Updated last month
- Software to implement GoT with a weviate vectorized database☆663Updated last month