modal-labs / stopwatchLinks
A tool for benchmarking LLMs on Modal
☆29Updated this week
Alternatives and similar repositories for stopwatch
Users that are interested in stopwatch are comparing it to the libraries listed below
Sorting:
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆37Updated last year
- PyTorch implementation for MRL☆18Updated last year
- Slides and recordings of talks hosted by our community☆20Updated last year
- ☆30Updated 7 months ago
- Framework for building and maintaining self-updating prompts for LLMs☆63Updated last year
- Parallel data preprocessing for NLP and ML.☆34Updated 7 months ago
- Training and Inference Notebooks for the RedPajama (OpenLlama) models☆18Updated 2 years ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 9 months ago
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…☆42Updated last year
- DEPRECATED--all functionality moved to nbdev☆15Updated 2 years ago
- ☆39Updated 2 months ago
- 🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)☆17Updated last year
- LLM training in simple, raw C/CUDA☆14Updated 6 months ago
- ☆61Updated last week
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated 2 years ago
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- A library for squeakily cleaning and filtering language datasets.☆47Updated last year
- Mixtral finetuning☆19Updated last year
- An unofficial Python client library for Lambda Lab's Cloud Computing Platform☆12Updated 2 years ago
- A sample pattern for running CI tests on Modal☆18Updated 2 months ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆31Updated 10 months ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆56Updated last week
- ☆77Updated last year
- Leverage your LangChain trace data for fine tuning☆41Updated 10 months ago
- ☆17Updated 2 years ago
- ☆22Updated last year
- ☆18Updated last week
- Drift detection module for machine learning pipelines.☆25Updated 2 years ago
- ☆28Updated 2 years ago
- experiments with inference on llama☆104Updated last year