Alternatives and similar repositories for friendli-client

Users that are interested in friendli-client are comparing it to the libraries listed below

• friendliai / friendli-model-optimizer
  FMO (Friendli Model Optimizer)
  ☆12Updated 6 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆24Updated 7 months ago
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆33Updated this week
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆61Updated 2 months ago
• bentoml / BentoLMDeploy
  Self-host LLMs with LMDeploy and BentoML
  ☆20Updated last week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 4 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• substratusai / vllm-docker
  ☆62Updated 3 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆133Updated last week
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆114Updated 5 months ago
• nyunAI / PruneGPT
  ☆52Updated last year
• fixie-ai / thefastest.ai
  Website with current metrics on the fastest AI models.
  ☆41Updated 8 months ago
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated 2 weeks ago
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆139Updated this week
• deep-diver / PingPong
  manage histories of LLM applied applications
  ☆91Updated last year
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated last year
• deepgrove-ai / Bonsai
  ☆22Updated 3 months ago
• friendliai / aipm
  AI Agent who manages your Jira project
  ☆18Updated last year
• lightblue-tech / lb-reranker
  ☆23Updated 5 months ago
• The-Swarm-Corporation / AgentParse
  AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…
  ☆13Updated 2 weeks ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated last year
• NEOS-AI / Neosearch
  AI-based search done right
  ☆18Updated this week
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated last week
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆68Updated last year
• guidance-ai / jsonschemabench
  ☆46Updated last month
• tensorfuse / tensorfuse-examples
  List of popular open-source models deployed on AWS using tensorfuse
  ☆28Updated 3 months ago
• skypilot-org / skypilot-catalog
  ☆25Updated this week
• sammcj / vlm-ui
  Web Interface for Vision Language Models Including InternVLM2
  ☆22Updated 11 months ago
• huggingface / screensuite
  ScreenSuite - The most comprehensive benchmarking suite for GUI Agents!
  ☆94Updated 3 weeks ago