Alternatives and similar repositories for LLM-Inference-Deployment-Tutorial

Users that are interested in LLM-Inference-Deployment-Tutorial are comparing it to the libraries listed below

• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆37Updated last year
• 18907305772 / FuseAI
  FuseAI Project
  ☆86Updated 3 months ago
• OpenLLMAI / OpenLLMDE
  OpenLLMDE: An open source data engineering framework for LLMs
  ☆17Updated last year
• thunlp / APB
  ☆27Updated 2 months ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆27Updated 2 weeks ago
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated 11 months ago
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Updated last year
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆32Updated 11 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated last year
• zexuanqiu / CLongEval
  CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models
  ☆40Updated last year
• liuqi6777 / pe_rank
  Leveraging passage embeddings for efficient listwise reranking with large language models.
  ☆40Updated 5 months ago
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆56Updated last year
• juvi21 / CoPE-cuda
  Contextual Position Encoding but with some custom CUDA Kernels https://arxiv.org/abs/2405.18719
  ☆22Updated 11 months ago
• onesuper / HuggingFace-Datasets-Text-Quality-Analysis
  Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…
  ☆53Updated last year
• BaichuanSEED / BaichuanSEED.github.io
  Official Repository for Paper "BaichuanSEED: Sharing the Potential of ExtensivE Data Collection and Deduplication by Introducing a Compet…
  ☆18Updated 8 months ago
• wangguojim / LargeScale
  ☆19Updated last year
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• Zheng0428 / COIG-Kun
  ☆36Updated 8 months ago
• WalkerMitty / Fast-Llama2
  Fast instruction tuning with Llama2
  ☆11Updated last year
• OpenCSGs / Awesome-SLMs
  survery of small language models
  ☆15Updated 9 months ago
• LowinLi / transformers-stream-generator
  This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…
  ☆95Updated last year
• yifeiwang77 / Self-Correction
  ☆20Updated 6 months ago
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆61Updated 2 months ago
• SunLemuria / OpenGPTAndBeyond
  Open efforts to implement ChatGPT-like models and beyond.
  ☆107Updated 9 months ago
• QwenLM / online_merging_optimizers
  Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment
  ☆75Updated 10 months ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆30Updated 3 weeks ago
• SomeoneKong / llm_long_context_bench202405
  ☆29Updated 8 months ago
• WENGSYX / LMTuner
  LMTuner: Make the LLM Better for Everyone
  ☆35Updated last year
• Alibaba-NLP / RankingGPT
  code for paper 《RankingGPT: Empowering Large Language Models in Text Ranking with Progressive Enhancement》
  ☆31Updated last year
• xlang-ai / batch-prompting
  [EMNLP 2023 Industry Track] A simple prompting approach that enables the LLMs to run inference in batches.
  ☆72Updated last year