Alternatives and similar repositories for LLM-Inference-Deployment-Tutorial

Users that are interested in LLM-Inference-Deployment-Tutorial are comparing it to the libraries listed below

• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆107Updated last year
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆40Updated 2 years ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆45Updated last year
• liutiedong / goat
  a Fine-tuned LLaMA that is Good at Arithmetic Tasks
  ☆178Updated 2 years ago
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• myscale / Retrieval-QA-Benchmark
  Benchmark baseline for retrieval qa applications
  ☆118Updated last year
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆38Updated 8 months ago
• OpenLLMAI / OpenLLMDE
  OpenLLMDE: An open source data engineering framework for LLMs
  ☆18Updated 2 years ago
• LowinLi / transformers-stream-generator
  This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…
  ☆96Updated last year
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆45Updated last year
• 18907305772 / FuseAI
  FuseAI Project
  ☆88Updated 11 months ago
• cuplv / text-to-sql-wizardcoder
  Leveraging large language models for text-to-SQL synthesis, this project fine-tunes WizardLM/WizardCoder-15B-V1.0 with QLoRA on a custom …
  ☆45Updated 2 years ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated last year
• CLUEbenchmark / SuperCLUE-Fin
  中文金融大模型测评基准，六大类二十五任务、等级化评价，国内模型获得A级
  ☆10Updated last year
• withmartian / leaderboard-backend
  Open sourced backend for Martian's LLM Inference Provider Leaderboard
  ☆19Updated last year
• google-deepmind / llms_can_learn_rules
  ☆63Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆94Updated last year
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆47Updated 2 years ago
• Bui1dMySea / MemLong
  ☆96Updated last year
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆40Updated last year
• anyscale / long-context-fine-tuning-blogpost
  ☆17Updated last year
• gomate-community / rageval
  Evaluation tools for Retrieval-augmented Generation (RAG) methods.
  ☆167Updated last year
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• GeneZC / MiniMA
  Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"
  ☆102Updated last year
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated 2 years ago
• xlang-ai / batch-prompting
  [EMNLP 2023 Industry Track] A simple prompting approach that enables the LLMs to run inference in batches.
  ☆77Updated last year
• terryyz / llm-benchmark
  A list of LLM benchmark frameworks.
  ☆73Updated last year
• microsoft / prose-benchmarks
  PROSE Public Benchmark Suite
  ☆28Updated 3 months ago
• shiyemin / light-hf-proxy
  A light proxy solution for HuggingFace hub.
  ☆49Updated 2 years ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆103Updated last year