Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.
☆51Sep 29, 2024Updated last year
Alternatives and similar repositories for evals
Users that are interested in evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Annoucing Instructor Cloud☆38Aug 14, 2024Updated last year
- A couple scripts to grab stats from email☆43Sep 10, 2024Updated last year
- ☆197May 5, 2024Updated 2 years ago
- ☆18Updated this week
- ☆37May 5, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A webhook that integrates the W&B model registry with Modal Labs☆15Dec 24, 2023Updated 2 years ago
- Run evals using LLM☆27Jan 8, 2026Updated 6 months ago
- Website for Applied-LLMs work☆29May 5, 2026Updated 2 months ago
- Wow!☆12Oct 25, 2024Updated last year
- ☆19Mar 16, 2025Updated last year
- ☆32Mar 1, 2023Updated 3 years ago
- Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Models☆28May 31, 2025Updated last year
- ☆30May 12, 2026Updated 2 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆37Jul 6, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This repo consists of prompting style of different widely used LLMs in the LLM space.☆37Jul 31, 2024Updated last year
- Creating Generative AI Apps which work☆17Apr 14, 2025Updated last year
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆203Apr 29, 2024Updated 2 years ago
- structured extraction for llms☆801Jan 27, 2025Updated last year
- Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.☆1,108Updated this week
- LobotoMl is a set of scripts and tools to assess production deployments of ML services☆10May 16, 2022Updated 4 years ago
- Render notebooks like nbviewer, but using Quarto as the renderer☆110May 5, 2025Updated last year
- Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…☆504Sep 10, 2025Updated 10 months ago
- Pydantic extension for annotating autocorrecting fields.☆220Jun 20, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- a collection of resources around LLMs, aggregated for the workshop "Mastering LLMs: End-to-End Fine-Tuning and Deployment" by Dan Becker …☆107May 31, 2024Updated 2 years ago
- Reproduction of the $80M Rari Finance Hack on April 30 2022 using on-chain fuzzing with Echidna☆15Jun 16, 2024Updated 2 years ago
- An MCP Server for Linkedin API☆38Mar 19, 2025Updated last year
- assign color hues to a collection of text fragments based on embeddings☆20Jun 15, 2024Updated 2 years ago
- A spotify playlist agent using CrewAI☆81May 29, 2024Updated 2 years ago
- A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.☆187Updated this week
- ☆102Jul 16, 2026Updated last week
- API and CLI tool to fetch and query Chome DevTools heap snapshots (Python & Playwright)☆16May 16, 2024Updated 2 years ago
- Improved GPT-3.5 Agent (with tools) for GPT-3.5☆20May 1, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆22Oct 14, 2024Updated last year
- DynamoDB Foreign Data Wrapper for PostgreSQL☆37Feb 10, 2025Updated last year
- An HTTP proxy that naively injects NTLM data for the current user into outgoing requests☆14Nov 14, 2018Updated 7 years ago
- How Safe is SF?☆10Aug 20, 2024Updated last year
- ☆12Mar 28, 2023Updated 3 years ago
- MCP server to dynamically connect to other MCP servers & exposes the entire MCP protocol via tool calls. Ideal for testing MCPs during de…☆21Apr 23, 2026Updated 3 months ago
- Implementation of N-Grammer in Flax☆17Nov 3, 2022Updated 3 years ago