Alternatives and similar repositories for friendli-client:

Users that are interested in friendli-client are comparing it to the libraries listed below

• friendliai / friendli-model-optimizer
  FMO (Friendli Model Optimizer)
  ☆12Updated last week
• friendliai / LLMServingPerfEvaluator
  ☆42Updated 4 months ago
• friendliai / FAI-Model
  FriendliAI Model Hub
  ☆89Updated 2 years ago
• friendliai / periflow-cli
  Welcome to PeriFlow CLI ☁︎
  ☆12Updated last year
• langchain-ai / langchain-upstage
  ☆11Updated last week
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆18Updated last month
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆74Updated 4 months ago
• skypilot-org / skypilot-catalog
  ☆21Updated this week
• Just1z / asyncgpt
  ⚡️ Asynchronous framework for ChatGPT API 🤖
  ☆21Updated last year
• rtzr / tritony
  Tiny configuration for Triton Inference Server
  ☆44Updated last week
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆59Updated 8 months ago
• LG-AI-EXAONE / EXAONE-3.5
  Official repository for EXAONE 3.5 built by LG AI Research
  ☆101Updated last month
• sionic-ai / flasma
  High-performance vector search engine with no loss of accuracy through GPU and dynamic placement
  ☆28Updated last year
• ml-energy / leaderboard
  How much energy do GenAI models consume?
  ☆41Updated 3 months ago
• UpstageAI / evalverse
  The Universe of Evaluation. All about the evaluation for LLMs.
  ☆221Updated 6 months ago
• cloneofsimo / fim-llama-deepspeed
  ☆31Updated last year
• moreh-io / motif-llm
  ☆25Updated last month
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆47Updated this week
• philschmid / text-generation-inference-tests
  ☆20Updated last year
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆46Updated this week
• deep-diver / PingPong
  manage histories of LLM applied applications
  ☆88Updated last year
• skypilot-org / sky-llama
  ☆25Updated last year
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆15Updated this week
• jaywonchung / dotfiles
  Dotfile management with bare git
  ☆19Updated last month
• swsnu / aisys2023
  ☆102Updated last year
• SqueezeBits / QUICK
  QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
  ☆114Updated 10 months ago
• yanolja / ogem
  ☆40Updated this week
• snuspl / pluto
  MIST: High-performance IoT Stream Processing
  ☆17Updated 5 years ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆79Updated this week