data cleaning and curation for unstructured text
☆329Aug 6, 2024Updated last year
Alternatives and similar repositories for galactic
Users that are interested in galactic are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Generate textbook-quality synthetic LLM pretraining data☆509Oct 19, 2023Updated 2 years ago
- visualize your gpu usage☆16Sep 5, 2023Updated 2 years ago
- ☆135Nov 24, 2023Updated 2 years ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Sep 10, 2023Updated 2 years ago
- Public reports detailing responses to sets of prompts by Large Language Models.☆32Jan 4, 2025Updated last year
- ⛓️ build cognitive systems, pythonic☆339Nov 19, 2024Updated last year
- Customizable implementation of the self-instruct paper.☆1,052Mar 7, 2024Updated 2 years ago
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆28Apr 21, 2023Updated 2 years ago
- utilities for loading and running text embeddings with onnx☆45Aug 16, 2025Updated 7 months ago
- Modified Stanford-Alpaca Trainer for Training Replit's Code Model☆43Jun 1, 2023Updated 2 years ago
- Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.☆44Sep 6, 2023Updated 2 years ago
- Just a bunch of benchmark logs for different LLMs☆119Jul 28, 2024Updated last year
- Efficient vector database for hundred millions of embeddings.☆212May 17, 2024Updated last year
- ☆13Aug 23, 2024Updated last year
- clean up your LLM datasets☆113May 30, 2023Updated 2 years ago
- 🤖 A PyTorch library of curated Transformer models and their composable components☆894Apr 17, 2024Updated last year
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,956Mar 16, 2026Updated last week
- ☆119Dec 18, 2024Updated last year
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,605Dec 20, 2025Updated 3 months ago
- Full finetuning of large language models without large memory requirements☆94Sep 22, 2025Updated 6 months ago
- batched loras☆351Sep 6, 2023Updated 2 years ago
- Natural language search for complex JSON arrays, with AI Quickstart.☆413Jun 5, 2024Updated last year
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆31May 29, 2023Updated 2 years ago
- Fine-tune mistral-7B on 3090s, a100s, h100s☆724Oct 11, 2023Updated 2 years ago
- ☆415Nov 2, 2023Updated 2 years ago
- utilities for batched llm calls with retries☆49Updated this week
- Cerule - A Tiny Mighty Vision Model☆68Nov 9, 2025Updated 4 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,131Updated this week
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆356Jun 2, 2025Updated 9 months ago
- Reverse Instructions to generate instruction tuning data with corpus examples☆214Mar 5, 2024Updated 2 years ago
- Collection of various text datasets to assist ML researchers in training or fine-tuning their models☆21Apr 1, 2023Updated 2 years ago
- A Simple Discord Bot for the Alpaca LLM☆98Jun 22, 2023Updated 2 years ago
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,882May 17, 2025Updated 10 months ago
- A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer☆1,629Sep 15, 2023Updated 2 years ago
- Chat Markup Language conversation library☆55Jan 3, 2024Updated 2 years ago
- QLoRA with Enhanced Multi GPU Support☆38Aug 8, 2023Updated 2 years ago
- Neural Search☆366Mar 11, 2025Updated last year
- Easily embed, cluster and semantically label text datasets☆600Mar 28, 2024Updated last year
- No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval☆29Sep 26, 2022Updated 3 years ago