garg-ankush / scipe
SCIPE is a powerful tool for evaluating and diagnosing LLM (Large Language Model) graphs or chains.
☆21Updated 4 months ago
Alternatives and similar repositories for scipe:
Users that are interested in scipe are comparing it to the libraries listed below
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆50Updated 4 months ago
- Writing Blog Posts with Generative Feedback Loops!☆47Updated 11 months ago
- Just a bunch of benchmark logs for different LLMs☆119Updated 7 months ago
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆122Updated 4 months ago
- ☆76Updated 9 months ago
- A framework for evaluating function calls made by LLMs☆37Updated 7 months ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆29Updated 6 months ago
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆94Updated 2 months ago
- Dynamic Metadata based RAG Framework☆72Updated 7 months ago
- Routing on Random Forest (RoRF)☆130Updated 5 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated 10 months ago
- ☆75Updated last year
- Prompt design in Python☆55Updated 3 months ago
- ☆88Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated 11 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆59Updated 7 months ago
- RAG example using DSPy, Gradio, FastAPI☆75Updated 11 months ago
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆49Updated 5 months ago
- DSPY on action with OpenSource LLMs.☆68Updated 11 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆72Updated last week
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆67Updated 4 months ago
- ☆31Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 8 months ago
- Verbosity control for AI agents☆60Updated 9 months ago
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆108Updated last week
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆63Updated 4 months ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated 5 months ago
- CAMEL framework-based multi-agent system for task-driven and dynamic environments☆81Updated 9 months ago
- freeact is a lightweight library for code-action based agents☆71Updated 2 weeks ago