instructlab / sdgLinks
Python library for Synthetic Data Generation
☆52Updated last month
Alternatives and similar repositories for sdg
Users that are interested in sdg are comparing it to the libraries listed below
Sorting:
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data☆49Updated this week
- 🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.☆56Updated this week
- IBM development fork of https://github.com/huggingface/text-generation-inference☆63Updated 4 months ago
- Python library for Evaluation☆16Updated this week
- Taxonomy tree that will allow you to create models tuned with your data☆290Updated 4 months ago
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆212Updated 2 weeks ago
- ☆270Updated 7 months ago
- codebase release for EMNLP2023 paper publication☆19Updated 4 months ago
- ☆43Updated last year
- Synthetic Data Generation Toolkit for LLMs☆95Updated last week
- The Granite Guardian models are designed to detect risks in prompts and responses.☆130Updated 3 months ago
- ☆50Updated last year
- Train, tune, and infer Bamba model☆138Updated 8 months ago
- Advanced Reasoning Benchmark Dataset for LLMs☆47Updated 2 years ago
- Mixing Language Models with Self-Verification and Meta-Verification☆112Updated last year
- ☆31Updated last year
- ☆76Updated 7 months ago
- Pre-training code for CrystalCoder 7B LLM☆57Updated last year
- Tooling for exact and MinHash deduplication of large-scale text datasets☆65Updated 3 weeks ago
- Small and Efficient Mathematical Reasoning LLMs☆73Updated 2 years ago
- LM engine is a library for pretraining/finetuning LLMs☆113Updated last week
- InstructLab Community wide collaboration space including contributing, security, code of conduct, etc☆94Updated last week
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆152Updated last year
- A framework for evaluating the effectiveness of chain-of-thought reasoning in language models.☆19Updated last year
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆36Updated 2 years ago
- ☆23Updated 2 years ago
- Auto-tuning for vllm. Getting the best performance out of your LLM deployment (vllm+guidellm+optuna)☆32Updated last week
- ReLM is a Regular Expression engine for Language Models☆107Updated 2 years ago
- ☆53Updated 3 months ago
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆120Updated 3 months ago