Alternatives and similar repositories for Workshop-TRT-LLM

Users that are interested in Workshop-TRT-LLM are comparing it to the libraries listed below

• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆117Updated 8 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆115Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated last year
• charlesfrye / minimodal
  A miniature version of Modal
  ☆23Updated last year
• YuchenJin / llm.c
  LLM training in simple, raw C/CUDA
  ☆15Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• muellerzr / nbdistributed
  Seemless interface of using PyTOrch distributed with Jupyter notebooks
  ☆57Updated 4 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 3 months ago
• cohere-ai / cohere-finetune
  A tool that facilitates easy, efficient and high-quality fine-tuning of Cohere's models
  ☆76Updated 10 months ago
• kevinwu23 / StanfordFineTuneBench
  ☆31Updated last year
• PrimeIntellect-ai / prime-vllm
  Modded vLLM to run pipeline parallelism over public networks
  ☆40Updated 8 months ago
• bipul1010 / agents_tutorial
  ☆19Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 weeks ago
• AnswerDotAI / fastdata
  ☆161Updated last year
• huggingface / competitions
  ☆125Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• brendanhogan / picoDeepResearch
  ☆68Updated 8 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆83Updated 2 years ago
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• teknium1 / transformers-gptq-quant
  ☆45Updated 2 years ago
• anyscale / ray-summit-2023-training
  ☆89Updated 2 years ago
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆34Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆66Updated 2 years ago
• UmerHA / quanting-notes
  I learn about and explain quantization
  ☆26Updated last year
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆133Updated last week
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆279Updated last year
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated last year
• QuixiAI / spectrum
  ☆140Updated 5 months ago