Alternatives and similar repositories for friendli-client:

Users that are interested in friendli-client are comparing it to the libraries listed below

• friendliai / friendli-model-optimizer
  FMO (Friendli Model Optimizer)
  ☆12Updated last month
• friendliai / LLMServingPerfEvaluator
  ☆45Updated 5 months ago
• friendliai / FAI-Model
  FriendliAI Model Hub
  ☆89Updated 2 years ago
• friendliai / periflow-cli
  Welcome to PeriFlow CLI ☁︎
  ☆12Updated last year
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 2 months ago
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆96Updated this week
• langchain-ai / langchain-upstage
  ☆11Updated last month
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆59Updated 9 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆78Updated 5 months ago
• friendliai / aipm
  AI Agent who manages your Jira project
  ☆15Updated 7 months ago
• rtzr / tritony
  Tiny configuration for Triton Inference Server
  ☆44Updated last month
• cloneofsimo / fim-llama-deepspeed
  ☆31Updated last year
• sionic-ai / flasma
  High-performance vector search engine with no loss of accuracy through GPU and dynamic placement
  ☆28Updated last year
• moreh-io / motif-llm
  ☆27Updated 2 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆21Updated this week
• skypilot-org / skypilot-catalog
  ☆22Updated this week
• huggingface / optimum-furiosa
  Accelerated inference of 🤗 models using FuriosaAI NPU chips.
  ☆26Updated 8 months ago
• tensorchord / llmspec
  OpenAI compatible API for open source LLMs
  ☆15Updated last year
• jaywonchung / dotfiles
  Dotfile management with bare git
  ☆19Updated this week
• deep-diver / PingPong
  manage histories of LLM applied applications
  ☆88Updated last year
• snuspl / pluto
  MIST: High-performance IoT Stream Processing
  ☆17Updated 5 years ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆59Updated 2 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆66Updated last week
• tyler-griggs / melange-release
  ☆43Updated 7 months ago
• davidkim205 / translation
  ☆11Updated 10 months ago
• yujonglee / eval
  Evaluate your LLM apps, RAG pipeline, any generated text, and more!
  Updated 9 months ago
• LG-AI-EXAONE / EXAONE-3.5
  Official repository for EXAONE 3.5 built by LG AI Research
  ☆139Updated 2 months ago
• mlc-ai / web-llm-assistant
  AI Assistant running within your browser.
  ☆59Updated 2 months ago