Alignment-Lab-AI / Dataset-Conversion-Toolkit
a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for ease of use with any trainer
☆13Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for Dataset-Conversion-Toolkit
- ☆19Updated 3 weeks ago
- ☆53Updated 5 months ago
- ☆64Updated 5 months ago
- ☆104Updated 8 months ago
- ☆31Updated 4 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆20Updated 9 months ago
- entropix style sampling + GUI☆25Updated 3 weeks ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 8 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆55Updated last week
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆62Updated 2 weeks ago
- A pipeline parallel training script for LLMs.☆83Updated this week
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- ☆27Updated last year
- ☆62Updated 2 weeks ago
- Simple examples using Argilla tools to build AI☆42Updated this week
- A framework for evaluating function calls made by LLMs☆35Updated 3 months ago
- Let's create synthetic textbooks together :)☆70Updated 9 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated 10 months ago
- ☆20Updated last year
- ☆38Updated 8 months ago
- A collection of pre-build wrappers over common RAG systems like ChromaDB, Weaviate, Pinecone, and othersz!☆20Updated last week
- Extract a single expert from a Mixture Of Experts model using slerp interpolation.☆17Updated 5 months ago
- Easily view and modify JSON datasets for large language models☆62Updated last month
- An unsupervised model merging algorithm for Transformers-based language models.☆100Updated 6 months ago
- All the world is a play, we are but actors in it.☆47Updated 4 months ago
- Model REVOLVER, a human in the loop model mixing system.☆33Updated last year
- ☆23Updated this week
- 5X faster 60% less memory QLoRA finetuning☆21Updated 5 months ago
- ☆28Updated this week
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆49Updated this week