Alternatives and similar repositories for happy_vllm

Users that are interested in happy_vllm are comparing it to the libraries listed below

• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆35Updated last year
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆45Updated last year
• Zyphra / transformers_zamba2
  ☆49Updated 10 months ago
• HITsz-TMG / KaLM-Embedding
  Code for KaLM-Embedding models
  ☆103Updated 5 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆45Updated last year
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆66Updated last year
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆88Updated 3 weeks ago
• LLM360 / k2-data-prep
  ☆21Updated last year
• kyegomez / FastFF
  Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"
  ☆16Updated last year
• Zyphra / Zyda_processing
  ☆39Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆32Updated 2 months ago
• nyunAI / PruneGPT
  ☆51Updated last year
• jina-ai / llm-query-expansion
  Query Expension for Better Query Embedding using LLMs
  ☆62Updated 9 months ago
• The-Inscrutable-X / TACQ
  Official Repository for Task-Circuit Quantization
  ☆24Updated 6 months ago
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆58Updated last week
• xverse-ai / XVERSE-MoE-A36B
  XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆38Updated last year
• cxcscmu / RAGViz
  Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]
  ☆88Updated 10 months ago
• attashe / ModifiedBeamSampler
  Modified Beam Search with periodical restart
  ☆12Updated last year
• lilakk / BLEUBERI
  Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"
  ☆31Updated 6 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆45Updated this week
• arcee-ai / DAM
  ☆55Updated last year
• ibm-granite / granite-embedding-models
  ☆48Updated 2 months ago
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆40Updated last year
• docling-project / docling-eval
  Evaluation framework for document processing models and services.
  ☆58Updated this week
• meetdavidwan / clamr
  CLaMR: Contextualized Late-Interaction for Multimodal Content Retrieval
  ☆22Updated 5 months ago
• lightblue-tech / lb-reranker
  ☆24Updated 10 months ago
• du-nlp-lab / MLR-Copilot
  ☆67Updated 8 months ago
• QuixiAI / SystemChat
  ☆31Updated last year
• kyegomez / Finetuning-Suite
  Finetune any model on HF in less than 30 seconds
  ☆56Updated last month
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆46Updated last year