Alternatives and similar repositories for happy_vllm

Users that are interested in happy_vllm are comparing it to the libraries listed below

• HITsz-TMG / KaLM-Embedding
  Code for KaLM-Embedding models
  ☆96Updated 4 months ago
• Zyphra / transformers_zamba2
  ☆49Updated 9 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆45Updated last year
• cxcscmu / RAGViz
  Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]
  ☆87Updated 10 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆44Updated last year
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆65Updated last year
• ibm-granite / granite-embedding-models
  ☆46Updated last month
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated 2 months ago
• LLM360 / k2-data-prep
  ☆21Updated last year
• kyegomez / FastFF
  Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"
  ☆15Updated last year
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆88Updated this week
• docling-project / docling-eval
  Evaluation framework for document processing models and services.
  ☆55Updated this week
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆39Updated last year
• NVIDIA / workbench-llamafactory
  This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.
  ☆67Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆35Updated last year
• xverse-ai / XVERSE-MoE-A36B
  XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆38Updated last year
• nyunAI / PruneGPT
  ☆51Updated last year
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆44Updated this week
• Zyphra / Zyda_processing
  ☆39Updated last year
• lightblue-tech / lb-reranker
  ☆23Updated 9 months ago
• QuixiAI / SystemChat
  ☆31Updated last year
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated last month
• du-nlp-lab / MLR-Copilot
  ☆67Updated 7 months ago
• jina-ai / submodular-optimization
  Submodular optimization for context engineering: query fan-out, text selection, passage reranking
  ☆77Updated 4 months ago
• lilakk / BLEUBERI
  Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"
  ☆28Updated 5 months ago
• EasyShopAI / rag-lab
  Lighter, cheaper and faster RAG toolkit (Graph RAG) supported by TargetPilot
  ☆46Updated 5 months ago
• kyegomez / Finetuning-Suite
  Finetune any model on HF in less than 30 seconds
  ☆55Updated 3 weeks ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆41Updated last year
• YihongT / LLMSynthor
  ☆19Updated 4 months ago
• anyscale / long-context-fine-tuning-blogpost
  ☆17Updated last year