Alternatives and similar repositories for Workshop-TRT-LLM

Users that are interested in Workshop-TRT-LLM are comparing it to the libraries listed below

• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆112Updated 3 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 8 months ago
• charlesfrye / minimodal
  A miniature version of Modal
  ☆20Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• anyscale / ray-summit-2023-training
  ☆87Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated 11 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆31Updated 11 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆120Updated last year
• huggingface / competitions
  ☆124Updated 10 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated last year
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆55Updated 3 weeks ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated 3 months ago
• teknium1 / transformers-gptq-quant
  ☆46Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 6 months ago
• cohere-ai / cohere-finetune
  A tool that facilitates easy, efficient and high-quality fine-tuning of Cohere's models
  ☆74Updated 5 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆83Updated last year
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆88Updated this week
• PrimeIntellect-ai / prime-vllm
  Modded vLLM to run pipeline parallelism over public networks
  ☆38Updated 3 months ago
• brendanhogan / picoDeepResearch
  ☆66Updated 3 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆119Updated this week
• parlance-labs / ftcourse
  ☆170Updated last year
• bipul1010 / agents_tutorial
  ☆19Updated last year
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆290Updated 3 months ago
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆32Updated last year
• modal-labs / stopwatch
  A tool for benchmarking LLMs on Modal
  ☆43Updated this week
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 4 months ago
• geronimi73 / phi2-finetune
  ☆88Updated last year
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆191Updated 3 months ago