Alternatives and similar repositories for LLM-Inference-Deployment-Tutorial

Users that are interested in LLM-Inference-Deployment-Tutorial are comparing it to the libraries listed below

• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆40Updated 2 years ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆46Updated last year
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆47Updated 9 months ago
• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated last year
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated 2 years ago
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆40Updated last year
• anyscale / long-context-fine-tuning-blogpost
  ☆17Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated last year
• EasyShopAI / rag-lab
  Lighter, cheaper and faster RAG toolkit (Graph RAG) supported by TargetPilot
  ☆46Updated 7 months ago
• BaichuanSEED / BaichuanSEED.github.io
  Official Repository for Paper "BaichuanSEED: Sharing the Potential of ExtensivE Data Collection and Deduplication by Introducing a Compet…
  ☆18Updated last year
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆45Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆34Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆94Updated last year
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆137Updated 2 years ago
• Bui1dMySea / MemLong
  ☆96Updated last year
• Bowen1911 / LLMs-Distillation-Quantification
  Repo of ACL 2025 Paper "Quantification of Large Language Model Distillation"
  ☆93Updated 6 months ago
• myscale / Retrieval-QA-Benchmark
  Benchmark baseline for retrieval qa applications
  ☆119Updated last year
• laramohan / wikillm
  LLMs as Collaboratively Edited Knowledge Bases
  ☆46Updated last year
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆60Updated 9 months ago
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆107Updated last year
• bentoml / BentoLMDeploy
  Self-host LLMs with LMDeploy and BentoML
  ☆22Updated last month
• jwoongkim11 / QA-RAG
  Code for the paper, From RAG to QA-RAG: Integrating Generative AI for Pharmaceutical Regulatory Compliance Process
  ☆23Updated last year
• onesuper / HuggingFace-Datasets-Text-Quality-Analysis
  Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…
  ☆53Updated 2 years ago
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated 2 years ago
• imagination-research / sot
  [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  ☆184Updated last year
• google-deepmind / llms_can_learn_rules
  ☆63Updated last year
• Anni-Zou / Meta-CoT
  Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models
  ☆101Updated 2 years ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆103Updated 5 months ago
• OpenLLMAI / OpenLLMDE
  OpenLLMDE: An open source data engineering framework for LLMs
  ☆18Updated 2 years ago
• liutiedong / goat
  a Fine-tuned LLaMA that is Good at Arithmetic Tasks
  ☆178Updated 2 years ago