Alternatives and similar repositories for friendli-client

Users that are interested in friendli-client are comparing it to the libraries listed below

• friendliai / friendli-model-optimizer
  FMO (Friendli Model Optimizer)
  ☆12Updated 5 months ago
• friendliai / LLMServingPerfEvaluator
  ☆46Updated 9 months ago
• friendliai / FAI-Model
  FriendliAI Model Hub
  ☆91Updated 3 years ago
• hunkim / o
  Toy O
  ☆16Updated 8 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 5 months ago
• friendliai / periflow-cli
  Welcome to PeriFlow CLI ☁︎
  ☆12Updated last year
• yujonglee / eval
  Evaluate your LLM apps, RAG pipeline, any generated text, and more!
  ☆1Updated last year
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆30Updated this week
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆133Updated this week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆89Updated 3 months ago
• rtzr / tritony
  Tiny configuration for Triton Inference Server
  ☆45Updated 4 months ago
• SqueezeBits / Torch-TRTLLM
  Ditto is an open-source framework that enables direct conversion of HuggingFace PreTrainedModels into TensorRT-LLM engines.
  ☆41Updated this week
• dnotitia / smoothie-qwen
  A lightweight adjustment tool for smoothing token probabilities in the Qwen models to encourage balanced multilingual generation.
  ☆72Updated last month
• davidkim205 / nox
  Efficient fine-tuning for ko-llm models
  ☆182Updated last year
• EleutherAI / oslo
  OSLO: Open Source for Large-scale Optimization
  ☆174Updated last year
• bentoml / BentoLMDeploy
  Self-host LLMs with LMDeploy and BentoML
  ☆20Updated 2 months ago
• SqueezeAILab / Tool2Vec
  Efficient and Scalable Estimation of Tool Representations in Vector Space
  ☆23Updated 9 months ago
• DongjunLee / langdict
  Build complex LLM Applications with Python Dictionary
  ☆40Updated 7 months ago
• snuspl / pluto
  MIST: High-performance IoT Stream Processing
  ☆17Updated 6 years ago
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆57Updated last year
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated last month
• jaywonchung / dotfiles
  Dotfile management with bare git
  ☆19Updated 3 weeks ago
• davidkim205 / translation
  ☆12Updated last year
• deep-diver / hf-daily-paper-newsletter
  Newsletter bot for 🤗 Daily Papers
  ☆121Updated this week
• gigio1023 / LLMCompiler-Pro
  An extended project of the LLM Compiler paper, focusing on developing LLM-based Autonomous Agents.
  ☆23Updated 7 months ago
• UpstageAI / evalverse
  The Universe of Evaluation. All about the evaluation for LLMs.
  ☆224Updated 10 months ago
• guidance-ai / jsonschemabench
  ☆39Updated last month
• radha-patel / SySTeC
  Performant kernels for symmetric tensors
  ☆15Updated 9 months ago
• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆94Updated 6 months ago
• mlc-ai / web-llm-assistant
  AI Assistant running within your browser.
  ☆67Updated 6 months ago