Alternatives and similar repositories for Workshop-TRT-LLM

Users that are interested in Workshop-TRT-LLM are comparing it to the libraries listed below

• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆112Updated last month
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated 9 months ago
• charlesfrye / minimodal
  A miniature version of Modal
  ☆20Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• PrimeIntellect-ai / prime-vllm
  Modded vLLM to run pipeline parallelism over public networks
  ☆37Updated last month
• cohere-ai / cohere-finetune
  A tool that facilitates easy, efficient and high-quality fine-tuning of Cohere's models
  ☆74Updated 4 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 5 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 11 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 7 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated last year
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆73Updated 2 weeks ago
• teknium1 / transformers-gptq-quant
  ☆47Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• huggingface / competitions
  ☆124Updated 8 months ago
• anyscale / ray-summit-2023-training
  ☆87Updated last year
• apple / ml-superposition-prompting
  ☆145Updated 11 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆116Updated 5 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆265Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated last year
• bipul1010 / agents_tutorial
  ☆19Updated 11 months ago
• geronimi73 / phi2-finetune
  ☆87Updated last year
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆77Updated this week
• hkproj / multi-latent-attention
  ☆43Updated last month
• cognitivecomputations / spectrum
  ☆128Updated 3 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆188Updated last month
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 9 months ago
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 5 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆101Updated 4 months ago