Alternatives and similar repositories for text-generation-inference:

Users that are interested in text-generation-inference are comparing it to the libraries listed below

• foundation-model-stack / fms-hf-tuning
  🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
  ☆40Updated this week
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆59Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆70Updated 2 months ago
• arcee-ai / DAM
  ☆48Updated 5 months ago
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• IBM / dolomite-engine
  Dolomite Engine is a library for pretraining/finetuning LLMs
  ☆47Updated this week
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆87Updated 11 months ago
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆49Updated 2 weeks ago
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆82Updated last month
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated 11 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆26Updated this week
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 10 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆73Updated 5 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆88Updated 3 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 11 months ago
• cognitivecomputations / spectrum
  ☆113Updated last week
• substratusai / vllm-docker
  ☆57Updated 2 weeks ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆34Updated this week
• run-ai / runai-model-streamer
  ☆190Updated 2 weeks ago
• runpod-workers / worker-sglang
  SGLang is fast serving framework for large language models and vision language models.
  ☆22Updated 2 months ago
• nyunAI / PruneGPT
  ☆53Updated 10 months ago
• Zyphra / Zyda_processing
  ☆33Updated 9 months ago
• instructlab / sdg
  Python library for Synthetic Data Generation
  ☆40Updated this week
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 10 months ago
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆54Updated 11 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆107Updated 2 months ago
• Digitous / LLM-SLERP-Merge
  Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
  ☆120Updated last year
• wdlctc / mini-s
  ☆50Updated 5 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆156Updated this week
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆32Updated 3 weeks ago