Alternatives and similar repositories for friendli-client

Users that are interested in friendli-client are comparing it to the libraries listed below

• friendliai / friendli-model-optimizer
  FMO (Friendli Model Optimizer)
  ☆12Updated 7 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆38Updated this week
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆29Updated 8 months ago
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 6 months ago
• substratusai / vllm-docker
  ☆63Updated 5 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆140Updated this week
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆61Updated 3 months ago
• fixie-ai / thefastest.ai
  Website with current metrics on the fastest AI models.
  ☆43Updated 9 months ago
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated 2 months ago
• NEOS-AI / Neosearch
  AI-based search done right
  ☆20Updated 3 weeks ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆66Updated last year
• mystic-ai / pipeline
  Pipeline is an open source python SDK for building AI/ML workflows
  ☆137Updated 11 months ago
• unclecode / pydantype
  A library to convert Pydantic models to TypedDict
  ☆33Updated last year
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆145Updated this week
• dwarvesf / llm-hosting
  This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…
  ☆24Updated 5 months ago
• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆52Updated last week
• cgftinc / benchmax
  Framework-Agnostic RL Environments for LLM Fine-Tuning
  ☆33Updated last week
• voyage-ai / voyageai-python
  Voyage AI Official Python Library
  ☆71Updated last month
• lightblue-tech / lb-reranker
  ☆23Updated 7 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆120Updated 7 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆85Updated 3 months ago
• sammcj / vlm-ui
  Web Interface for Vision Language Models Including InternVLM2
  ☆23Updated last year
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
  ☆72Updated this week
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 9 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆31Updated 7 months ago
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆127Updated 3 months ago
• run-ai / runai-model-streamer
  ☆238Updated this week
• friendliai / LLMServingPerfEvaluator
  ☆47Updated 11 months ago
• The-Swarm-Corporation / swarms-cloud
  Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.
  ☆45Updated 2 weeks ago