Alternatives and similar repositories for friendli-client

Users that are interested in friendli-client are comparing it to the libraries listed below

• friendliai / friendli-model-optimizer
  FMO (Friendli Model Optimizer)
  ☆12Updated 8 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆40Updated this week
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆29Updated 9 months ago
• runpod-workers / worker-sglang
  SGLang is fast serving framework for large language models and vision language models.
  ☆26Updated last month
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆31Updated 8 months ago
• lightblue-tech / lb-reranker
  ☆23Updated 7 months ago
• fixie-ai / thefastest.ai
  Website with current metrics on the fastest AI models.
  ☆43Updated 10 months ago
• NEOS-AI / Neosearch
  AI-based search done right
  ☆20Updated 3 weeks ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 10 months ago
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated 2 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆149Updated last week
• dwarvesf / llm-hosting
  This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…
  ☆24Updated 6 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 6 months ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆61Updated this week
• cloneofsimo / fim-llama-deepspeed
  ☆32Updated last year
• deep-diver / PingPong
  manage histories of LLM applied applications
  ☆91Updated last year
• substratusai / vllm-docker
  ☆64Updated 5 months ago
• nyunAI / PruneGPT
  ☆51Updated last year
• ialacol / text-inference-batcher
  A high performance batching router optimises max throughput for text inference workload
  ☆16Updated 2 years ago
• cgftinc / benchmax
  Framework-Agnostic RL Environments for LLM Fine-Tuning
  ☆35Updated this week
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• friendliai / aipm
  AI Agent who manages your Jira project
  ☆20Updated last year
• langchain-ai / langchain-upstage
  ☆13Updated last month
• LLM360 / k2-data-prep
  ☆21Updated last year
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆66Updated last year
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated last year
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆22Updated 9 months ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆29Updated last year
• BlackHC / llmtracer
  Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
  ☆14Updated 7 months ago
• cloneofsimo / auto_llm_codebase_analysis
  ☆26Updated last year