davanstrien / haiku-dpo
Using open source LLMs to build synthetic datasets for direct preference optimization
☆57Updated 11 months ago
Alternatives and similar repositories for haiku-dpo:
Users that are interested in haiku-dpo are comparing it to the libraries listed below
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 7 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated 11 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆64Updated 3 months ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated 4 months ago
- ☆24Updated last year
- ☆113Updated 4 months ago
- ☆30Updated 7 months ago
- ☆65Updated 8 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆67Updated 4 months ago
- Set of scripts to finetune LLMs☆36Updated 10 months ago
- A framework for evaluating function calls made by LLMs☆36Updated 6 months ago
- ☆48Updated last year
- Writing Blog Posts with Generative Feedback Loops!☆47Updated 11 months ago
- ☆48Updated 3 months ago
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- Chunk your text using gpt4o-mini more accurately☆43Updated 6 months ago
- Simple examples using Argilla tools to build AI☆53Updated 3 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆130Updated this week
- Generalist and Lightweight Model for Text Classification☆65Updated this week
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆59Updated 3 months ago
- C++ inference wrappers for running blazing fast embedding services on your favourite serverless like AWS Lambda. By Prithivi Da, PRs welc…☆21Updated 11 months ago
- Fine-tune ModernBERT on a large Dataset with Custom Tokenizer Training☆59Updated last week
- Pre-train Static Word Embeddings☆47Updated 3 weeks ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆29Updated 5 months ago
- Efficient few-shot learning with cross-encoders.☆48Updated last year
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆63Updated last month
- Explore the use of DSPy for extracting features from PDFs 🔎☆38Updated 11 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆100Updated 2 months ago
- This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data☆63Updated last year