Alternatives and similar repositories for happy_vllm

Users that are interested in happy_vllm are comparing it to the libraries listed below

• ibm-granite / granite-embedding-models
  ☆53Updated 3 months ago
• kyegomez / FastFF
  Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"
  ☆16Updated last year
• docling-project / docling-eval
  Evaluation framework for document processing models and services.
  ☆62Updated last week
• Zyphra / transformers_zamba2
  ☆48Updated 11 months ago
• LLM360 / k2-data-prep
  ☆21Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆34Updated last year
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆46Updated last year
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆45Updated last year
• mmhamdy / open-language-models
  A list of language models with permissive licenses such as MIT or Apache 2.0
  ☆24Updated 11 months ago
• meetdavidwan / clamr
  CLaMR: Contextualized Late-Interaction for Multimodal Content Retrieval
  ☆23Updated 7 months ago
• HITsz-TMG / KaLM-Embedding
  Code for KaLM-Embedding models
  ☆112Updated 7 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆65Updated last year
• ArturTanona / grpo_unsloth_docker
  ☆57Updated 11 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆32Updated 4 months ago
• nyunAI / PruneGPT
  ☆51Updated last year
• YihongT / LLMSynthor
  ☆21Updated 6 months ago
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆90Updated 3 weeks ago
• hcompai / hai-cookbook
  H.AI cookbook provides code examples and guides to help developers use models developed by H Company.
  ☆62Updated last week
• Zyphra / Zyda_processing
  ☆41Updated last year
• cloneofsimo / auto_llm_codebase_analysis
  ☆27Updated last year
• hellangleZ / Qwen3_autothink_adapter
  Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…
  ☆22Updated 8 months ago
• kyegomez / MobileVLM
  Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …
  ☆15Updated last year
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated 2 years ago
• xverse-ai / XVERSE-MoE-A36B
  XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆38Updated last year
• a-antoniades / swe-search
  ☆11Updated last year
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated 2 years ago
• jina-ai / llm-query-expansion
  Query Expension for Better Query Embedding using LLMs
  ☆64Updated 11 months ago
• yynil / RWKVInside
  ☆40Updated 9 months ago
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated 3 weeks ago
• du-nlp-lab / MLR-Copilot
  ☆67Updated 10 months ago