rasbt / litdataLinks
Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.
☆11Updated 10 months ago
Alternatives and similar repositories for litdata
Users that are interested in litdata are comparing it to the libraries listed below
Sorting:
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated last year
- ☆31Updated last year
- Testing paligemma2 finetuning on reasoning dataset☆18Updated 6 months ago
- ☆77Updated last year
- Dynamic Metadata based RAG Framework☆75Updated 11 months ago
- Build Agentic workflows with function calling using open LLMs☆28Updated last week
- ☆40Updated 2 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆108Updated 3 months ago
- ☆19Updated 11 months ago
- Example implementation of Iteration of Tought - Gives a star if you like the project☆42Updated 6 months ago
- Repository containing awesome resources regarding Hugging Face tooling.☆47Updated last year
- ☆11Updated last year
- ☆48Updated 5 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 9 months ago
- A competition to get you started on the NeurIPS AI Hackercup☆28Updated 9 months ago
- Verbosity control for AI agents☆64Updated last year
- Python Server for C3 AI app. A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) with…☆23Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 5 months ago
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated last month
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆73Updated this week
- ☆47Updated 9 months ago
- Text to Python Objects via a LLM Function Call☆58Updated last year
- ☆53Updated 8 months ago
- Writing Blog Posts with Generative Feedback Loops!☆49Updated last year
- Explore the use of DSPy for extracting features from PDFs 🔎☆44Updated last year
- Your local personalised AI agent☆43Updated 7 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆35Updated 2 years ago
- A tutorial on DSPy and whether automated prompt engineering lives up to the hype☆23Updated last year
- AI_Powered_Dev_Search_Engine☆12Updated last year
- ☆23Updated 2 months ago