friendliai / friendli-clientLinks
[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI
☆48Updated 2 months ago
Alternatives and similar repositories for friendli-client
Users that are interested in friendli-client are comparing it to the libraries listed below
Sorting:
- FMO (Friendli Model Optimizer)☆12Updated 8 months ago
- vLLM adapter for a TGIS-compatible gRPC server.☆40Updated this week
- Nexusflow function call, tool use, and agent benchmarks.☆29Updated 9 months ago
- SGLang is fast serving framework for large language models and vision language models.☆26Updated last month
- Public reports detailing responses to sets of prompts by Large Language Models.☆31Updated 8 months ago
- ☆23Updated 7 months ago
- Website with current metrics on the fastest AI models.☆43Updated 10 months ago
- AI-based search done right☆20Updated 3 weeks ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 10 months ago
- Sentence Embedding as a Service☆15Updated 2 months ago
- Self-host LLMs with vLLM and BentoML☆149Updated last week
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆24Updated 6 months ago
- A collection of all available inference solutions for the LLMs☆91Updated 6 months ago
- IBM development fork of https://github.com/huggingface/text-generation-inference☆61Updated this week
- ☆32Updated last year
- manage histories of LLM applied applications☆91Updated last year
- ☆64Updated 5 months ago
- ☆51Updated last year
- A high performance batching router optimises max throughput for text inference workload☆16Updated 2 years ago
- Framework-Agnostic RL Environments for LLM Fine-Tuning☆35Updated this week
- Tutorial to get started with SkyPilot!☆58Updated last year
- AI Agent who manages your Jira project☆20Updated last year
- ☆13Updated last month
- ☆21Updated last year
- Transformer GPU VRAM estimator☆66Updated last year
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated last year
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated 9 months ago
- Complex RAG backend☆29Updated last year
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 7 months ago
- ☆26Updated last year