BlackHC / llmtracer
Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
☆14Updated last month
Alternatives and similar repositories for llmtracer:
Users that are interested in llmtracer are comparing it to the libraries listed below
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 6 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆34Updated last year
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆37Updated last year
- A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.☆16Updated 5 months ago
- Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…☆19Updated 3 weeks ago
- Rust bindings for CTranslate2☆14Updated last year
- Creating Generative AI Apps which work☆17Updated 9 months ago
- Sentence Embedding as a Service☆15Updated last year
- ☆37Updated last year
- Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…☆16Updated last year
- Lightning Fast: Faiss CPU + Onnx Quantized Multilingual Embedding Model☆23Updated 7 months ago
- ☆15Updated last week
- The backend behind the LLM-Perf Leaderboard☆10Updated 11 months ago
- A library for squeakily cleaning and filtering language datasets.☆46Updated last year
- Tools for formatting large language model prompts.☆12Updated last year
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated last year
- Run LLMs on Replicate with vLLM☆17Updated 6 months ago
- Public reports detailing responses to sets of prompts by Large Language Models.☆30Updated 3 months ago
- Using modal.com to process FineWeb-edu data☆20Updated last week
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆33Updated last year
- 🤝 Trade any tensors over the network☆30Updated last year
- Chat Markup Language conversation library☆55Updated last year
- Explore the use of DSPy for extracting features from PDFs 🔎☆39Updated last year
- A text-to-SQL prototype on the northwind sqlite dataset☆12Updated 6 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated 3 months ago
- A sample pattern for running CI tests on Modal☆17Updated this week
- ☆40Updated 2 months ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated last year
- ☆22Updated last year
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year