basetenlabs / Workshop-TRT-LLM
☆16Updated 7 months ago
Alternatives and similar repositories for Workshop-TRT-LLM:
Users that are interested in Workshop-TRT-LLM are comparing it to the libraries listed below
- ☆24Updated last year
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆37Updated 9 months ago
- A miniature version of Modal☆19Updated 7 months ago
- ☆19Updated 5 months ago
- ☆76Updated 7 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆29Updated 4 months ago
- Just a bunch of benchmark logs for different LLMs☆117Updated 6 months ago
- ☆49Updated 8 months ago
- ☆48Updated last year
- ☆27Updated 2 months ago
- An introduction to LLM Sampling☆75Updated last month
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- SCIPE is a powerful tool for evaluating and diagnosing LLM (Large Language Model) graphs or chains.☆21Updated 2 months ago
- LLM training in simple, raw C/CUDA☆14Updated last month
- Because it's there.☆14Updated 4 months ago
- KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…☆24Updated last year
- Verbosity control for AI agents☆59Updated 8 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated 9 months ago
- ☆65Updated 8 months ago
- ☆18Updated 3 months ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆101Updated 7 months ago
- Chat Markup Language conversation library☆55Updated last year
- Routing on Random Forest (RoRF)☆100Updated 4 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 6 months ago
- Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning☆28Updated this week
- Run LLMs on Replicate with vLLM☆15Updated 3 months ago
- Tutorial for building LLM router☆173Updated 6 months ago
- Inference examples☆32Updated 2 weeks ago
- look how they massacred my boy☆63Updated 3 months ago
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆30Updated last year