lchen001 / FrugalML
This is the repository holding code and data for "FrugalML: How to Use ML Prediction APIs More Accurately and Cheaply".
☆31Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for FrugalML
- Finding semantically meaningful and accurate prompts.☆46Updated last year
- ☆16Updated last year
- Experiments to assess SPADE on different LLM pipelines.☆16Updated 7 months ago
- Reproducible, flexible LLM evaluations☆19Updated this week
- Hyperparameter tuning via uncertainty modeling☆46Updated 6 months ago
- Experiments on GPT-3's ability to fit numerical models in-context.☆14Updated 2 years ago
- ☆28Updated last year
- Evaluation of neuro-symbolic engines☆33Updated 3 months ago
- ☆31Updated last year
- Documentation for dynamic machine learning systems.☆27Updated 2 months ago
- Official code release for the paper Coder Reviewer Reranking for Code Generation.☆42Updated last year
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆109Updated last year
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆79Updated last year
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆93Updated 5 months ago
- Google Research☆46Updated 2 years ago
- Cross-field empirical trends analysis of XAI literature☆20Updated last year
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆37Updated 5 months ago
- Understanding the correlation between different LLM benchmarks☆29Updated 10 months ago
- [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf☆22Updated last year
- ☆22Updated last year
- Data for "Datamodels: Predicting Predictions with Training Data"☆91Updated last year
- ☆39Updated 10 months ago
- Code for the ACL 2023 paper: "Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Sc…☆28Updated last year
- The repository contains code for Adaptive Data Optimization☆18Updated last month
- Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.☆38Updated 7 months ago
- Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval☆14Updated 10 months ago
- Official repository for the paper "Zero-Shot AutoML with Pretrained Models"☆41Updated 10 months ago
- The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions☆68Updated last year
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆37Updated last year
- 📰 Computing the information content of trained neural networks☆21Updated 3 years ago