hamelsmu / ft-drift
Check for data drift between two OpenAI multi-turn chat jsonl files.
☆37Updated 11 months ago
Alternatives and similar repositories for ft-drift:
Users that are interested in ft-drift are comparing it to the libraries listed below
- ☆76Updated 9 months ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆29Updated 7 months ago
- ☆78Updated 10 months ago
- ☆62Updated 4 months ago
- ☆19Updated 5 months ago
- Writing Blog Posts with Generative Feedback Loops!☆47Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 6 months ago
- A framework for evaluating function calls made by LLMs☆37Updated 8 months ago
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆50Updated 6 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆127Updated 3 months ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆100Updated last year
- NLP with Rust for Python 🦀🐍☆61Updated 9 months ago
- Tools to make language models a bit easier to use☆39Updated this week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated 3 months ago
- ☆24Updated last year
- Leverage your LangChain trace data for fine tuning☆41Updated 7 months ago
- Creating Generative AI Apps which work☆17Updated 8 months ago
- 🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)☆17Updated last year
- experiments with inference on llama☆104Updated 9 months ago
- ☆38Updated last month
- Analysis on the cost of encoder based models☆11Updated last month
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 8 months ago
- A miniature version of Modal☆20Updated 9 months ago
- Chunk your text using gpt4o-mini more accurately☆44Updated 7 months ago
- Crispy reranking models by Mixedbread☆19Updated last week
- A library for squeakily cleaning and filtering language datasets.☆46Updated last year
- Efficient few-shot learning with cross-encoders.☆50Updated last year
- Framework for building and maintaining self-updating prompts for LLMs☆61Updated 9 months ago
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆101Updated this week
- ☆150Updated 3 months ago