Alternatives and similar repositories for triton-co-pilot

Users that are interested in triton-co-pilot are comparing it to the libraries listed below

• huggingface / candle-cublaslt
  ☆12Updated last year
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆139Updated last year
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆93Updated 10 months ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆62Updated 3 months ago
• lancedb / ragged
  ☆21Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆103Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆84Updated last month
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆38Updated 8 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆276Updated this week
• ibm-granite / granite-embedding-models
  ☆50Updated 2 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆32Updated last year
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆115Updated 7 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆94Updated last week
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆48Updated 2 years ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated last year
• mlabonne / chessllm
  ☆41Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆65Updated 2 years ago
• mistralai / mistral-evals
  ☆82Updated last month
• muellerzr / nbdistributed
  Seemless interface of using PyTOrch distributed with Jupyter notebooks
  ☆57Updated 3 months ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆70Updated 2 years ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆59Updated last year
• basetenlabs / Workshop-TRT-LLM
  ☆19Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆38Updated last year
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆54Updated 6 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 9 months ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆153Updated last year
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆186Updated 11 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆11Updated last year
• Preemo-Inc / text-generation-inference
  ☆198Updated last year