Alternatives and similar repositories for friendli-client:

Users that are interested in friendli-client are comparing it to the libraries listed below

• friendliai / friendli-model-optimizer
  FMO (Friendli Model Optimizer)
  ☆12Updated 3 months ago
• friendliai / LLMServingPerfEvaluator
  ☆45Updated 7 months ago
• friendliai / FAI-Model
  FriendliAI Model Hub
  ☆92Updated 2 years ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 4 months ago
• deep-diver / PingPong
  manage histories of LLM applied applications
  ☆88Updated last year
• friendliai / periflow-cli
  Welcome to PeriFlow CLI ☁︎
  ☆12Updated last year
• SqueezeBits / Torch-TRTLLM
  Ditto is an open-source framework that enables direct conversion of HuggingFace PreTrainedModels into TensorRT-LLM engines.
  ☆38Updated this week
• langchain-ai / langchain-upstage
  ☆11Updated 2 months ago
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆61Updated 11 months ago
• bentoml / BentoCLIP
  building a CLIP application using BentoML
  ☆10Updated last month
• yujonglee / eval
  Evaluate your LLM apps, RAG pipeline, any generated text, and more!
  Updated 11 months ago
• jaywonchung / dotfiles
  Dotfile management with bare git
  ☆19Updated 2 weeks ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆26Updated this week
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆127Updated this week
• rtzr / tritony
  Tiny configuration for Triton Inference Server
  ☆45Updated 3 months ago
• sionic-ai / flasma
  High-performance vector search engine with no loss of accuracy through GPU and dynamic placement
  ☆29Updated last year
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• moreh-io / motif-llm
  ☆31Updated 4 months ago
• runpod-workers / worker-sglang
  SGLang is fast serving framework for large language models and vision language models.
  ☆22Updated 2 months ago
• DongjunLee / langdict
  Build complex LLM Applications with Python Dictionary
  ☆40Updated 6 months ago
• friendliai / aipm
  AI Agent who manages your Jira project
  ☆16Updated 10 months ago
• EleutherAI / oslo
  OSLO: Open Source for Large-scale Optimization
  ☆175Updated last year
• philschmid / text-generation-inference-tests
  ☆20Updated last year
• davidkim205 / nox
  Efficient fine-tuning for ko-llm models
  ☆183Updated last year
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆106Updated last week
• isEmmanuelOlowe / llm-cost-estimator
  Estimating hardware and cloud costs of LLMs and transformer projects
  ☆14Updated last year
• deep-diver / hf-daily-paper-newsletter
  Newsletter bot for 🤗 Daily Papers
  ☆118Updated this week
• snuspl / pluto
  MIST: High-performance IoT Stream Processing
  ☆17Updated 6 years ago
• skypilot-org / skypilot-catalog
  ☆23Updated this week
• swsnu / aisys2023
  ☆101Updated last year