taylorai / galactic
data cleaning and curation for unstructured text
☆329Updated 7 months ago
Alternatives and similar repositories for galactic:
Users that are interested in galactic are comparing it to the libraries listed below
- Generate textbook-quality synthetic LLM pretraining data☆498Updated last year
- Fast & more realistic evaluation of chat language models. Includes leaderboard.☆184Updated last year
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆171Updated 6 months ago
- Synthetic Data for LLM Fine-Tuning☆111Updated last year
- ☆195Updated 10 months ago
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆408Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆227Updated 3 weeks ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆224Updated 10 months ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆100Updated last year
- 📚 Datasets and models for instruction-tuning☆234Updated last year
- Neural Search☆351Updated this week
- Domain Adapted Language Modeling Toolkit - E2E RAG☆315Updated 4 months ago
- Efficient vector database for hundred millions of embeddings.☆206Updated 9 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- Easily embed, cluster and semantically label text datasets☆513Updated 11 months ago
- ⛓️ build cognitive systems, pythonic☆331Updated 3 months ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆107Updated 3 weeks ago
- A simple Python sandbox for helpful LLM data agents☆228Updated 8 months ago
- ☆152Updated 7 months ago
- Use the OpenAI Batch tool to make async batch requests to the OpenAI API.☆95Updated last year
- Convert all of libgen to high quality markdown☆248Updated last year
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆189Updated 5 months ago
- Prompt programming with FMs.☆440Updated 7 months ago
- This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Da…☆487Updated 11 months ago
- awesome synthetic (text) datasets☆263Updated 4 months ago
- ☆207Updated 8 months ago
- Fine-tune mistral-7B on 3090s, a100s, h100s☆706Updated last year
- ☆221Updated last year
- A comprehensive deep dive into the world of tokens☆222Updated 8 months ago
- ☆149Updated 3 months ago