Alternatives and similar repositories for Workshop-TRT-LLM

Users that are interested in Workshop-TRT-LLM are comparing it to the libraries listed below

• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆112Updated 3 weeks ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated last year
• PrimeIntellect-ai / prime-vllm
  Modded vLLM to run pipeline parallelism over public networks
  ☆37Updated last month
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated last year
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated 9 months ago
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆31Updated 10 months ago
• pacman100 / peft-codegen-25
  ☆23Updated last year
• charlesfrye / minimodal
  A miniature version of Modal
  ☆20Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆47Updated 4 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated 11 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆78Updated 6 months ago
• eugeneyan / visualizing-finetunes
  ☆78Updated last year
• kevinwu23 / StanfordFineTuneBench
  ☆30Updated 7 months ago
• UmerHA / quanting-notes
  I learn about and explain quantization
  ☆26Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆61Updated last year
• hkproj / multi-latent-attention
  ☆39Updated last month
• lightonai / fast-plaid
  High-Performance Engine for Multi-Vector Search
  ☆106Updated 2 weeks ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated last month
• ekshaks / ragpipe
  Iterate fast on your RAG pipelines
  ☆23Updated this week
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆53Updated 4 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 11 months ago
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆283Updated 3 weeks ago
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 4 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 9 months ago
• aniketmaurya / discord-llm-bot
  Fun project: LLM powered RAG Discord Bot that works seamlessly on CPU
  ☆32Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• parlance-labs / ftcourse
  ☆170Updated last year