instructlab / sdg
Python library for Synthetic Data Generation
☆13Updated last week
Related projects: ⓘ
- InstructLab Training Library☆13Updated last week
- IBM development fork of https://github.com/huggingface/text-generation-inference☆52Updated this week
- Taxonomy tree that will allow you to create models tuned with your data☆177Updated this week
- Open source project for data preparation of LLM application builders☆124Updated this week
- InstructLab Community wide collaboration space including contributing, security, code of conduct, etc☆69Updated this week
- GitHub bot to assist with the taxonomy contribution workflow☆14Updated this week
- codebase release for EMNLP2023 paper publication☆19Updated 6 months ago
- Examples for building and running LLM services and applications locally with Podman☆100Updated this week
- ☆37Updated this week
- 🦄 Unitxt: a python library for getting data fired up and set for training and evaluation☆151Updated this week
- 🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.☆21Updated this week
- Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…☆103Updated last month
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆26Updated last year
- End-to-End LLM Guide☆91Updated 2 months ago
- ☆12Updated last week
- Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.☆98Updated last week
- ☆15Updated 3 months ago
- ☆24Updated 2 months ago
- ☆11Updated 3 months ago
- Red Hat Enterprise Linux AI -- Developer Preview☆136Updated 2 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆32Updated last year
- InstructLab Command-Line Interface. Use this to chat with a model and execute the InstructLab workflow to train a model using custom tax…☆782Updated this week
- Self-host LLMs with vLLM and BentoML☆62Updated this week
- ☆24Updated last year
- ☆20Updated 8 months ago
- Benchmark suite for LLMs from Fireworks.ai☆51Updated this week
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆86Updated 3 months ago
- Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning☆40Updated 9 months ago
- Evaluation and analysis code for LLM360☆75Updated 3 months ago
- Tools for merging pretrained large language models.☆19Updated 3 months ago