neuml / txtinstruct
π Datasets and models for instruction-tuning
β235Updated last year
Alternatives and similar repositories for txtinstruct:
Users that are interested in txtinstruct are comparing it to the libraries listed below
- Domain Adapted Language Modeling Toolkit - E2E RAGβ316Updated 4 months ago
- β199Updated last year
- data cleaning and curation for unstructured textβ329Updated 7 months ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytesβ¦β147Updated last year
- Neural Searchβ352Updated last week
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.β414Updated last year
- Small finetuned LLMs for a diverse set of useful tasksβ126Updated last year
- Generate textbook-quality synthetic LLM pretraining dataβ498Updated last year
- Notebooks for training universal 0-shot classifiers on many different tasksβ120Updated 2 months ago
- π Retrieval augmented generation (RAG) and language model powered search applicationsβ286Updated 3 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAIβ224Updated 10 months ago
- FastFit β‘ When LLMs are Unfit Use FastFit β‘ Fast and Effective Text Classification with Many Classesβ190Updated 5 months ago
- Fast & more realistic evaluation of chat language models. Includes leaderboard.β185Updated last year
- A command-line interface to generate textual and conversational datasets with LLMs.β293Updated last year
- Completion After Prompt Probability. Make your LLM make a choiceβ74Updated 4 months ago
- awesome synthetic (text) datasetsβ265Updated 4 months ago
- Lightweight demos for finetuning LLMs. Powered by π€ transformers and open-source datasets.β73Updated 5 months ago
- β412Updated last year
- β449Updated last year
- Toolkit for attaching, training, saving and loading of new heads for transformer modelsβ265Updated 2 weeks ago
- This repo is for handling Question Answering, especially for Multi-hop Question Answeringβ67Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models accessβ¦β114Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.β82Updated last year
- Open-Source Implementation of WizardLM to turn documents into Q:A pairs for LLM fine-tuningβ300Updated 5 months ago
- ReLM is a Regular Expression engine for Language Modelsβ103Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vectoβ¦β229Updated last month
- π Reference-Free automatic summarization evaluation with potential hallucination detectionβ100Updated last year
- A joint community effort to create one central leaderboard for LLMs.β293Updated 7 months ago
- This is our own implementation of 'Layer Selective Rank Reduction'β233Updated 9 months ago
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hubβ158Updated last year