garg-ankush / scipe
SCIPE is a powerful tool for evaluating and diagnosing LLM (Large Language Model) graphs or chains.
☆21Updated 3 months ago
Alternatives and similar repositories for scipe:
Users that are interested in scipe are comparing it to the libraries listed below
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆50Updated 3 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆58Updated 7 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆60Updated 3 months ago
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆119Updated 4 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆100Updated 10 months ago
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆71Updated 4 months ago
- ☆76Updated 8 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated 10 months ago
- ☆88Updated last year
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆93Updated 2 months ago
- A framework for evaluating function calls made by LLMs☆36Updated 6 months ago
- ☆57Updated last year
- Leverage your LangChain trace data for fine tuning☆41Updated 6 months ago
- Routing on Random Forest (RoRF)☆114Updated 4 months ago
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆48Updated 4 months ago
- Dynamic Metadata based RAG Framework☆71Updated 6 months ago
- Writing Blog Posts with Generative Feedback Loops!☆47Updated 11 months ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated 4 months ago
- Tools to make language models a bit easier to use☆34Updated last month
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆64Updated 3 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆79Updated last year
- Simple examples using Argilla tools to build AI☆53Updated 3 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆101Updated 2 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆101Updated 2 months ago
- ☆48Updated last year
- LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…☆79Updated 3 weeks ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆29Updated 5 months ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆76Updated last week
- Reactive DDD with DSPy☆22Updated 11 months ago
- ☆27Updated 8 months ago