hamelsmu / ft-drift
Check for data drift between two OpenAI multi-turn chat jsonl files.
☆37Updated 9 months ago
Alternatives and similar repositories for ft-drift:
Users that are interested in ft-drift are comparing it to the libraries listed below
- ☆77Updated 8 months ago
- ☆57Updated 2 months ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆29Updated 5 months ago
- ☆76Updated 7 months ago
- ☆18Updated 3 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆34Updated last year
- experiments with inference on llama☆104Updated 7 months ago
- ☆24Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆119Updated last month
- Tools to make language models a bit easier to use☆33Updated last week
- ☆27Updated 2 months ago
- 🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)☆17Updated 10 months ago
- Writing Blog Posts with Generative Feedback Loops!☆47Updated 10 months ago
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆48Updated 4 months ago
- Leverage your LangChain trace data for fine tuning☆40Updated 5 months ago
- ☆147Updated last month
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆91Updated last month
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 6 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated last month
- Generalist and Lightweight Model for Text Classification☆59Updated last week
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆29Updated 4 months ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆99Updated last year
- Website for Applied-LLMs work☆21Updated 3 weeks ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- Iterate fast on your RAG pipelines☆22Updated last month
- Creating Generative AI Apps which work☆16Updated 6 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆52Updated 11 months ago
- Framework for building and maintaining self-updating prompts for LLMs☆59Updated 7 months ago
- A framework for evaluating function calls made by LLMs☆36Updated 6 months ago
- ☆12Updated 9 months ago