Alignment-Lab-AI / datagenLinks
a pipeline for using api calls to agnostically convert unstructured data into structured training data
☆29Updated 8 months ago
Alternatives and similar repositories for datagen
Users that are interested in datagen are comparing it to the libraries listed below
Sorting:
- ☆22Updated last year
- ☆48Updated last year
- ☆23Updated last year
- ☆49Updated 6 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆62Updated last year
- A library for squeakily cleaning and filtering language datasets.