rasbt / litdataLinks
Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.
☆12Updated last year
Alternatives and similar repositories for litdata
Users that are interested in litdata are comparing it to the libraries listed below
Sorting:
- ☆30Updated last year
- Dynamic Metadata based RAG Framework☆75Updated last year
- Writing Blog Posts with Generative Feedback Loops!☆50Updated last year
- Testing paligemma2 finetuning on reasoning dataset☆18Updated 8 months ago
- ☆40Updated 9 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated last year
- Repository containing awesome resources regarding Hugging Face tooling.☆48Updated last year
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆75Updated 9 months ago
- ☆11Updated 2 years ago
- Example implementation of Iteration of Tought - Gives a star if you like the project☆43Updated 8 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆111Updated 5 months ago
- ☆23Updated 4 months ago
- ☆20Updated 2 years ago
- This repository contains a toy implementation of a basic RAQA system.☆20Updated last year
- Explore the use of DSPy for extracting features from PDFs 🔎☆45Updated last year
- Python Server for C3 AI app. A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) with…☆24Updated last year
- 💙 Unstructured Data Connectors for Haystack 2.0☆17Updated last year
- AI_Powered_Dev_Search_Engine☆12Updated last year
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆124Updated last week
- A tutorial on DSPy and whether automated prompt engineering lives up to the hype☆24Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 7 months ago
- ☆95Updated 5 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆67Updated 10 months ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆75Updated 11 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆39Updated last year
- LlamaWorksDB is a Retrieval Augmented Generation (RAG) product designed to interact with the documentation of various products such as Ll…☆16Updated last year
- Luth is a state-of-the-art series of fine-tuned LLMs for French☆30Updated 3 weeks ago
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆55Updated 4 months ago
- Example code using the DSPy framework.☆19Updated last year