modal-labs / stopwatchLinks
A tool for benchmarking LLMs on Modal
☆45Updated 3 months ago
Alternatives and similar repositories for stopwatch
Users that are interested in stopwatch are comparing it to the libraries listed below
Sorting:
- Seemless interface of using PyTOrch distributed with Jupyter notebooks☆57Updated 2 months ago
- Framework for building and maintaining self-updating prompts for LLMs☆64Updated last year
- ML/DL Math and Method notes☆64Updated 2 years ago
- A sample pattern for running CI tests on Modal☆18Updated 8 months ago
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…☆44Updated last year
- ☆31Updated last year
- Tools for merging pretrained large language models.☆19Updated last year
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆36Updated 2 years ago
- ☆53Updated 10 months ago
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆39Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Updated 2 months ago
- ☆42Updated 7 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆35Updated 2 years ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆45Updated last year
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆67Updated 2 months ago
- LLM training in simple, raw C/CUDA☆15Updated last year
- Leverage your LangChain trace data for fine tuning☆46Updated last year
- ☆80Updated last year
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆33Updated last year
- Creating Generative AI Apps which work☆17Updated 7 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆88Updated 3 weeks ago
- PyTorch implementation for MRL☆20Updated last year
- NLP with Rust for Python 🦀🐍☆70Updated 7 months ago
- experiments with inference on llama☆103Updated last year
- Drift detection module for machine learning pipelines.☆23Updated 2 years ago
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆67Updated 2 years ago
- 🚀🤗 A collection of templates for Hugging Face Spaces☆35Updated 2 years ago
- 🤝 Trade any tensors over the network☆30Updated 2 years ago
- A collection of reproducible inference engine benchmarks☆38Updated 7 months ago
- machine learning model performance metrics & charts with confidence intervals, optimized with numba to be fast☆16Updated 3 years ago