Alternatives and similar repositories for Workshop-TRT-LLM:

Users that are interested in Workshop-TRT-LLM are comparing it to the libraries listed below

• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 9 months ago
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆107Updated this week
• lancedb / ragged
  ☆19Updated 6 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 2 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated 10 months ago
• bipul1010 / agents_tutorial
  ☆19Updated 8 months ago
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 2 months ago
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆30Updated 7 months ago
• pacman100 / peft-codegen-25
  ☆24Updated last year
• kevinwu23 / StanfordFineTuneBench
  ☆28Updated 5 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆106Updated 6 months ago
• charlesfrye / minimodal
  A miniature version of Modal
  ☆20Updated 10 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 6 months ago
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• BBischof / yapping
  Verbosity control for AI agents
  ☆61Updated 10 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated last year
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆77Updated 3 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 3 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• cohere-ai / cohere-finetune
  A tool that facilitates easy, efficient and high-quality fine-tuning of Cohere's models
  ☆72Updated last month
• aniketmaurya / Agents
  Build Agentic workflows with function calling using open LLMs
  ☆26Updated last week
• abacusai / gh200-llm
  Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning
  ☆38Updated last month
• eugeneyan / visualizing-finetunes
  ☆78Updated 10 months ago
• arcee-ai / DAM
  ☆48Updated 5 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆88Updated 2 months ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆48Updated last week
• anyscale / ray-summit-2023-training
  ☆85Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 months ago