basetenlabs / Workshop-TRT-LLMLinks
☆19Updated last year
Alternatives and similar repositories for Workshop-TRT-LLM
Users that are interested in Workshop-TRT-LLM are comparing it to the libraries listed below
Sorting:
- Fine-tune an LLM to perform batch inference and online serving.☆115Updated 7 months ago
- Seemless interface of using PyTOrch distributed with Jupyter notebooks☆57Updated 3 months ago
- An introduction to LLM Sampling☆79Updated last year
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- A set of scripts and notebooks on LLM finetunning and dataset creation☆113Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- A miniature version of Modal☆23Updated last year
- ☆23Updated 2 years ago
- ☆89Updated 2 years ago
- I learn about and explain quantization☆26Updated last year
- ☆125Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆107Updated 3 months ago
- LLM training in simple, raw C/CUDA☆15Updated last year
- A tool that facilitates easy, efficient and high-quality fine-tuning of Cohere's models☆76Updated 9 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Updated 2 years ago
- Build Agentic workflows with function calling using open LLMs☆28Updated this week
- ☆80Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 2 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆32Updated last year
- experiments with inference on llama☆103Updated last year
- Verbosity control for AI agents☆66Updated last year
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆39Updated last year
- ☆19Updated last year
- Set of scripts to finetune LLMs☆38Updated last year
- ☆21Updated last year
- ☆68Updated 7 months ago
- ML/DL Math and Method notes☆65Updated 2 years ago
- Simple UI for debugging correlations of text embeddings☆306Updated 7 months ago
- Let's build better datasets, together!☆267Updated last year
- Iterate fast on your RAG pipelines☆23Updated 6 months ago