Alternatives and similar repositories for happy_vllm

Users that are interested in happy_vllm are comparing it to the libraries listed below

• Zyphra / transformers_zamba2
  ☆48Updated 7 months ago
• HITsz-TMG / KaLM-Embedding
  Code for KaLM-Embedding models
  ☆91Updated 2 months ago
• cxcscmu / RAGViz
  Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]
  ☆85Updated 8 months ago
• kyegomez / FastFF
  Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"
  ☆16Updated 10 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆45Updated last year
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆87Updated this week
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆40Updated this week
• xverse-ai / XVERSE-MoE-A36B
  XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆38Updated last year
• YihongT / LLMSynthor
  ☆18Updated 2 months ago
• LLM360 / k2-data-prep
  ☆21Updated last year
• du-nlp-lab / MLR-Copilot
  ☆67Updated 5 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆43Updated last year
• ibm-granite / granite-embedding-models
  ☆40Updated last week
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆64Updated last year
• mmhamdy / open-language-models
  A list of language models with permissive licenses such as MIT or Apache 2.0
  ☆24Updated 6 months ago
• jina-ai / llm-query-expansion
  Query Expension for Better Query Embedding using LLMs
  ☆57Updated 7 months ago
• The-Inscrutable-X / TACQ
  Official Repository for Task-Circuit Quantization
  ☆23Updated 3 months ago
• hellangleZ / Qwen3_autothink_adapter
  Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…
  ☆22Updated 4 months ago
• nyunAI / PruneGPT
  ☆51Updated last year
• AlexBodner / How_Much_VRAM
  ☆102Updated last year
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆56Updated last week
• Zyphra / Zyda_processing
  ☆39Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated this week
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆34Updated last year
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆44Updated 9 months ago
• google-deepmind / llms_can_learn_rules
  ☆59Updated 9 months ago
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated last week
• anyscale / long-context-fine-tuning-blogpost
  ☆17Updated last year
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated 2 months ago