Alternatives and similar repositories for Workshop-TRT-LLM

Users that are interested in Workshop-TRT-LLM are comparing it to the libraries listed below

• muellerzr / nbdistributed
  Seemless interface of using PyTOrch distributed with Jupyter notebooks
  ☆55Updated 2 months ago
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆113Updated 5 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆58Updated last month
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 11 months ago
• kevinwu23 / StanfordFineTuneBench
  ☆31Updated last year
• charlesfrye / minimodal
  A miniature version of Modal
  ☆21Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆33Updated last year
• anyscale / ray-summit-2023-training
  ☆89Updated 2 years ago
• huggingface / competitions
  ☆124Updated last year
• YuchenJin / llm.c
  LLM training in simple, raw C/CUDA
  ☆15Updated 11 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆103Updated last year
• PrimeIntellect-ai / prime-vllm
  Modded vLLM to run pipeline parallelism over public networks
  ☆40Updated 6 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆101Updated this week
• aniketmaurya / Agents
  Build Agentic workflows with function calling using open LLMs
  ☆28Updated 3 weeks ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆48Updated last year
• teknium1 / transformers-gptq-quant
  ☆45Updated 2 years ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆64Updated last year
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 9 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated 2 years ago
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆11Updated last year
• QuixiAI / spectrum
  ☆138Updated 3 months ago
• brendanhogan / picoDeepResearch
  ☆68Updated 6 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆122Updated 10 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆277Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 7 months ago