friendliai / friendli-client
Friendli: the fastest serving engine for generative AI
☆42Updated last week
Related projects ⓘ
Alternatives and complementary repositories for friendli-client
- ☆40Updated 2 months ago
- FriendliAI Model Hub☆89Updated 2 years ago
- Welcome to PeriFlow CLI ☁︎☆12Updated last year
- A collection of all available inference solutions for the LLMs☆73Updated 2 months ago
- SGLang is fast serving framework for large language models and vision language models.☆11Updated 2 weeks ago
- Nexusflow function call, tool use, and agent benchmarks.☆14Updated this week
- ☆120Updated this week
- 1-Click is all you need.☆59Updated 6 months ago
- Modular and structured prompt caching for low-latency LLM inference☆68Updated last week
- High-performance vector search engine with no loss of accuracy through GPU and dynamic placement☆28Updated last year
- Evaluate your LLM apps, RAG pipeline, any generated text, and more!☆0Updated 6 months ago
- ☆26Updated last year
- Sentence Embedding as a Service☆14Updated last year
- manage histories of LLM applied applications☆86Updated last year
- Self-host LLMs with vLLM and BentoML☆74Updated last week
- ☆31Updated 10 months ago
- How much energy do GenAI models consume?☆41Updated last month
- ☆38Updated 4 months ago
- ☆12Updated 2 weeks ago
- An extended project of the LLM Compiler paper, focusing on developing LLM-based Autonomous Agents.☆22Updated last month
- Tutorial to get started with SkyPilot!☆56Updated 6 months ago
- Deep Learning Energy Measurement and Optimization☆218Updated this week
- Visualize expert firing frequencies across sentences in the Mixtral MoE model☆17Updated 10 months ago
- Google TPU optimizations for transformers models☆75Updated this week
- Dotfile management with bare git☆18Updated 3 weeks ago
- ☆53Updated 5 months ago
- "Learning-based One-line intelligence Owner Network Connectivity Tool"☆15Updated last year
- ☆37Updated last year
- IBM development fork of https://github.com/huggingface/text-generation-inference☆57Updated last month