friendliai / friendli-client

Related projects ⓘ

Alternatives and complementary repositories for friendli-client

• friendliai / LLMServingPerfEvaluator
  ☆40Updated 2 months ago
• friendliai / FAI-Model
  FriendliAI Model Hub
  ☆89Updated 2 years ago
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆59Updated 6 months ago
• friendliai / periflow-cli
  Welcome to PeriFlow CLI ☁︎
  ☆12Updated last year
• deep-diver / PingPong
  manage histories of LLM applied applications
  ☆86Updated 11 months ago
• hunkim / llm_gpu_cal
  🔮 LLM GPU Calculator
  ☆20Updated last year
• Just1z / asyncgpt
  ⚡️ Asynchronous framework for ChatGPT API 🤖
  ☆21Updated last year
• mlsys-seo / ooo-backprop
  ☆24Updated last year
• rtzr / tritony
  Tiny configuration for Triton Inference Server
  ☆43Updated 4 months ago
• cloneofsimo / fim-llama-deepspeed
  ☆31Updated 10 months ago
• gyunggyung / LiOnConnect
  "Learning-based One-line intelligence Owner Network Connectivity Tool"
  ☆15Updated last year
• deep-diver / hf-daily-paper-newsletter
  Newsletter bot for 🤗 Daily Papers
  ☆106Updated this week
• sionic-ai / flasma
  High-performance vector search engine with no loss of accuracy through GPU and dynamic placement
  ☆28Updated last year
• naem1023 / LLMCompiler-Pro
  An extended project of the LLM Compiler paper, focusing on developing LLM-based Autonomous Agents.
  ☆22Updated 3 weeks ago
• runpod-workers / worker-sglang
  SGLang is fast serving framework for large language models and vision language models.
  ☆10Updated this week
• casys-kaist / DaCapo
  ☆12Updated last week
• daemyung / practice-triton
  삼각형의 실전! Triton
  ☆14Updated 8 months ago
• jaywonchung / dotfiles
  Dotfile management with bare git
  ☆18Updated 2 weeks ago
• hscspring / llama.np
  Inference Llama/Llama2 Modes in NumPy
  ☆19Updated 11 months ago
• LangDict / langdict
  Build complex LLM Applications with Python Dictionary
  ☆27Updated last month
• skypilot-org / skypilot-catalog
  ☆20Updated this week
• yujonglee / eval
  Evaluate your LLM apps, RAG pipeline, any generated text, and more!
  ☆0Updated 6 months ago
• deep-diver / janus
  generate synthetic data for LLM fine-tuning in arbitrary situations within systematic way
  ☆21Updated 7 months ago
• huggingface / optimum-furiosa
  Accelerated inference of 🤗 models using FuriosaAI NPU chips.
  ☆26Updated 4 months ago
• EleutherAI / oslo
  OSLO: Open Source for Large-scale Optimization
  ☆174Updated last year
• swsnu / aisys2023
  ☆100Updated last year
• deep-diver / hllama
  hllama is a library which aims to provide a set of utility tools for large language models.
  ☆10Updated 6 months ago
• UpstageAI / evalverse
  The Universe of Evaluation. All about the evaluation for LLMs.
  ☆214Updated 4 months ago
• deep-diver / LLM-Serve
  This repository provides a framework to serve LLM(Large Language Model) based applications such as Chatbot.
  ☆17Updated last year