data cleaning and curation for unstructured text
☆327Aug 6, 2024Updated 2 years ago
Alternatives and similar repositories for galactic
Users that are interested in galactic are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Generate textbook-quality synthetic LLM pretraining data☆507Oct 19, 2023Updated 3 years ago
- visualize your gpu usage☆16Sep 5, 2023Updated 3 years ago
- Curate better data for LLMs☆1,066Mar 19, 2024Updated 2 years ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Sep 10, 2023Updated 3 years ago
- A multi-purpose LLM framework for RAG and data creation.☆622Jan 13, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- utilities for loading and running text embeddings with onnx☆46Aug 16, 2025Updated last year
- Customizable implementation of the self-instruct paper.☆1,051Mar 7, 2024Updated 2 years ago
- ☆133Nov 24, 2023Updated 2 years ago
- ⛓️ build cognitive systems, pythonic☆340Nov 19, 2024Updated 2 years ago
- Public reports detailing responses to sets of prompts by Large Language Models.☆42Jan 4, 2025Updated last year
- Example of using Vector Search algorithms for non-traditional workloads, like GIS, stock prices, and sets☆16May 10, 2023Updated 3 years ago
- 🤖 A PyTorch library of curated Transformer models and their composable components☆887Apr 17, 2024Updated 2 years ago
- clean up your LLM datasets☆113May 30, 2023Updated 3 years ago
- ☆15Apr 26, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Enemies for your LLM☆41Updated this week
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆28Apr 21, 2023Updated 3 years ago
- Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.☆44Sep 6, 2023Updated 3 years ago
- Efficient vector database for hundred millions of embeddings.☆218May 17, 2024Updated 2 years ago
- ☆13Aug 23, 2024Updated 2 years ago
- ☆128Dec 18, 2024Updated last year
- Full finetuning of large language models without large memory requirements☆92Sep 22, 2025Updated last year
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆3,427Updated this week
- Modified Stanford-Alpaca Trainer for Training Replit's Code Model☆46Jun 1, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,643Dec 20, 2025Updated 11 months ago
- Convert all of libgen to high quality markdown☆253Dec 13, 2023Updated 2 years ago
- utilities for batched llm calls with retries☆55Nov 14, 2026Updated last week
- batched loras☆351Sep 6, 2023Updated 3 years ago
- Just a bunch of benchmark logs for different LLMs☆131Jul 28, 2024Updated 2 years ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,466Updated this week
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,977May 17, 2025Updated last year
- Fine-tune mistral-7B on 3090s, a100s, h100s☆741Oct 11, 2023Updated 3 years ago
- Cerule - A Tiny Mighty Vision Model☆71Nov 9, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Natural language search for complex JSON arrays, with AI Quickstart.☆413Jun 5, 2024Updated 2 years ago
- ☆414Nov 2, 2023Updated 3 years ago
- Automatically evaluate your LLMs in Google Colab☆700May 7, 2024Updated 2 years ago
- Late Interaction Models Training & Retrieval☆914Jul 23, 2026Updated 3 months ago
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆1,126Feb 2, 2025Updated last year
- Reverse Instructions to generate instruction tuning data with corpus examples☆214Mar 5, 2024Updated 2 years ago
- String-to-String Algorithms for Natural Language Processing☆568Jan 25, 2026Updated 9 months ago
Are these results useful?