abhimanyupallavisudhir / costlyLinks
Estimate costs of complex LLM workflows in advance before spending money
☆10Updated 7 months ago
Alternatives and similar repositories for costly
Users that are interested in costly are comparing it to the libraries listed below
Sorting:
- code for training and using chess embeddings models☆13Updated last year
- Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…☆22Updated last year
- Writing Blog Posts with Generative Feedback Loops!☆50Updated last year
- Exploring limitations of LLM-as-a-judge☆19Updated last year
- Feste is a free and open-source framework allowing scalable composition of NLP tasks using a graph execution model that is optimized and …☆43Updated 2 years ago
- Evaluation framework for document processing models and services.☆59Updated this week
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆107Updated 3 months ago
- ☆62Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆71Updated last year
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆103Updated last year
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆67Updated 2 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆110Updated last year
- A repository re-creating the PromptBreeder Evolutionary Algorithm from the DeepMind Paper in Python using LMQL as the backend.☆28Updated 2 years ago
- Experiments to assess SPADE on different LLM pipelines.☆17Updated last year
- Simple GRPO scripts and configurations.☆59Updated 10 months ago
- Explore the use of DSPy for extracting features from PDFs 🔎☆49Updated last year
- a WIP architecture designed to allow transformers to think in a manner without tokens☆20Updated last year
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆35Updated last year
- ☆41Updated last year
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…☆44Updated last year
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆21Updated 2 years ago
- A library for squeakily cleaning and filtering language datasets.☆49Updated 2 years ago
- Merge LLM that are split in to parts☆27Updated 4 months ago
- A pytest plugin to organize and track algorithm visualizations☆18Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 8 months ago
- ☆22Updated 2 years ago
- Finding semantically meaningful and accurate prompts.☆48Updated 2 years ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆35Updated last year
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆39Updated last year