hamelsmu / ft-drift
Check for data drift between two OpenAI multi-turn chat jsonl files.
☆37Updated 10 months ago
Alternatives and similar repositories for ft-drift:
Users that are interested in ft-drift are comparing it to the libraries listed below
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆29Updated 6 months ago
- ☆58Updated 3 months ago
- ☆77Updated 9 months ago
- ☆76Updated 8 months ago
- Leverage your LangChain trace data for fine tuning☆41Updated 7 months ago
- Writing Blog Posts with Generative Feedback Loops!☆47Updated 11 months ago
- ☆18Updated 4 months ago
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆94Updated 2 months ago
- A framework for evaluating function calls made by LLMs☆37Updated 7 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆123Updated 2 months ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆100Updated last year
- ☆150Updated 3 months ago
- Tools to make language models a bit easier to use☆36Updated last week
- experiments with inference on llama☆104Updated 8 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆29Updated 5 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated 2 months ago
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆48Updated 5 months ago
- ☆24Updated last year
- ☆27Updated 3 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 7 months ago
- Generalist and Lightweight Model for Text Classification☆87Updated this week
- minimal pytorch implementation of bm25 (with sparse tensors)☆97Updated last year
- A miniature version of Modal☆20Updated 8 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆80Updated 11 months ago
- Framework for building and maintaining self-updating prompts for LLMs☆61Updated 8 months ago
- Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K …☆78Updated 2 months ago
- NLP with Rust for Python 🦀🐍☆61Updated 9 months ago
- Command Line Interface for Hugging Face Inference Endpoints☆66Updated 10 months ago