data cleaning and curation for unstructured text
☆329Aug 6, 2024Updated last year
Alternatives and similar repositories for galactic
Users that are interested in galactic are comparing it to the libraries listed below
Sorting:
- Generate textbook-quality synthetic LLM pretraining data☆509Oct 19, 2023Updated 2 years ago
- ☆135Nov 24, 2023Updated 2 years ago
- visualize your gpu usage☆16Sep 5, 2023Updated 2 years ago
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆27Apr 21, 2023Updated 2 years ago
- 🤖 A PyTorch library of curated Transformer models and their composable components☆894Apr 17, 2024Updated last year
- ⛓️ build cognitive systems, pythonic☆339Nov 19, 2024Updated last year
- ☆119Dec 18, 2024Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Sep 10, 2023Updated 2 years ago
- Efficient vector database for hundred millions of embeddings.☆212May 17, 2024Updated last year
- utilities for loading and running text embeddings with onnx☆45Aug 16, 2025Updated 6 months ago
- Customizable implementation of the self-instruct paper.☆1,049Mar 7, 2024Updated last year
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,599Dec 20, 2025Updated 2 months ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,903Feb 24, 2026Updated last week
- batched loras☆350Sep 6, 2023Updated 2 years ago
- Full finetuning of large language models without large memory requirements☆94Sep 22, 2025Updated 5 months ago
- utilities for batched llm calls with retries☆46Updated this week
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆354Jun 2, 2025Updated 9 months ago
- Neural Search☆367Mar 11, 2025Updated 11 months ago
- Modified Stanford-Alpaca Trainer for Training Replit's Code Model☆42Jun 1, 2023Updated 2 years ago
- Natural language search for complex JSON arrays, with AI Quickstart.☆412Jun 5, 2024Updated last year
- Easily embed, cluster and semantically label text datasets☆596Mar 28, 2024Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆267Dec 4, 2025Updated 2 months ago
- ☆415Nov 2, 2023Updated 2 years ago
- Reverse Instructions to generate instruction tuning data with corpus examples☆215Mar 5, 2024Updated last year
- A pythonic library providing light-weighted interface with LLMs☆131May 23, 2025Updated 9 months ago
- Just a bunch of benchmark logs for different LLMs☆119Jul 28, 2024Updated last year
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,859May 17, 2025Updated 9 months ago
- clean up your LLM datasets☆113May 30, 2023Updated 2 years ago
- Late Interaction Models Training & Retrieval☆732Updated this week
- A multi-purpose LLM framework for RAG and data creation.☆629Jan 13, 2024Updated 2 years ago
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆31May 29, 2023Updated 2 years ago
- Fine-tune mistral-7B on 3090s, a100s, h100s☆724Oct 11, 2023Updated 2 years ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,108Feb 23, 2026Updated last week
- Public reports detailing responses to sets of prompts by Large Language Models.☆32Jan 4, 2025Updated last year
- ☆13Aug 23, 2024Updated last year
- Label, clean and enrich text datasets with LLMs.☆2,302Mar 5, 2025Updated 11 months ago
- A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer☆1,630Sep 15, 2023Updated 2 years ago
- QLoRA with Enhanced Multi GPU Support☆38Aug 8, 2023Updated 2 years ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆46Mar 29, 2024Updated last year