honeyhiveai / realignLinks
Realign is a testing and simulation framework for AI applications.
☆18Updated last year
Alternatives and similar repositories for realign
Users that are interested in realign are comparing it to the libraries listed below
Sorting:
- Writing Blog Posts with Generative Feedback Loops!☆50Updated last year
- Sphynx Hallucination Induction☆53Updated 11 months ago
- a single interface around speech-to-speech foundation models☆27Updated 6 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- A repository re-creating the PromptBreeder Evolutionary Algorithm from the DeepMind Paper in Python using LMQL as the backend.☆28Updated 2 years ago
- Mixing Language Models with Self-Verification and Meta-Verification☆111Updated last year
- Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.☆58Updated 10 months ago
- OpenPipe Reinforcement Learning Experiments☆32Updated 9 months ago
- A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.☆100Updated 8 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆69Updated last month
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆81Updated last year
- utilities for loading and running text embeddings with onnx☆44Updated 4 months ago
- Simple Graph Memory for AI applications☆90Updated 7 months ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆65Updated last year
- Streamlit app for recommending eval functions using prompt diffs☆30Updated 2 years ago
- ☆45Updated 2 years ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 2 months ago
- AI Evaluation Platform☆47Updated 7 months ago
- ReLM is a Regular Expression engine for Language Models☆107Updated 2 years ago
- Thorn in a HaizeStack test for evaluating long-context adversarial robustness.☆26Updated last year
- ☆74Updated last year
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- Synthetic Data for LLM Fine-Tuning☆120Updated 2 years ago
- ☆53Updated 11 months ago
- Small, simple agent task environments for training and evaluation☆19Updated last year
- ☆19Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆150Updated this week
- Red-Teaming Language Models with DSPy☆249Updated 10 months ago
- Chat Markup Language conversation library☆55Updated 2 years ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆103Updated last year