anarchy-ai / llm-speed-benchmark

Related projects: ⓘ

• NoteDance / Note
  Machine learning library, Distributed training, Deep learning, Reinforcement learning, Models, TensorFlow, PyTorch
  ☆53Updated 2 weeks ago
• mify-io / mify-llm-editor
  LLM code editor for backend services
  ☆10Updated 2 months ago
• unifyai / aibench-llm-endpoints
  Runner in charge of collecting metrics from LLM inference endpoints for the Unify Hub
  ☆16Updated 7 months ago
• datasette / datasette-query-assistant
  Query databases and tables with AI assistance
  ☆14Updated 5 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆25Updated 11 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆62Updated this week
• the-crypt-keeper / tiny_starcoder
  Python examples using the bigcode/tiny_starcoder_py 159M model to generate code
  ☆43Updated last year
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆17Updated 8 months ago
• lucyknada / detective-needle-llm
  ☆10Updated last month
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆51Updated last week
• teleprint-me / py.gpt.prompt
  PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…
  ☆28Updated 4 months ago
• MichaelMcCulloch / WikiDex
  ☆29Updated 4 months ago
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆55Updated 8 months ago
• minimaxir / chatgpt-structured-data
  Demos of ChatGPT's function calling/structured data support.
  ☆22Updated 9 months ago
• emrgnt-cmplxty / zero-shot-replication
  ☆71Updated last year
• itsPreto / VECTR8
  Embed anything.
  ☆30Updated 3 months ago
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆11Updated 4 months ago
• mgerstgrasser / tacheles
  a lightweight, open-source blueprint for building powerful and scalable LLM chat applications
  ☆30Updated 3 months ago
• cognitivecomputations / kraken
  ☆64Updated 3 months ago
• zby / LLMEasyTools
  Tools for LLM agents.
  ☆55Updated last month
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆11Updated last month
• substratusai / vllm-docker
  ☆43Updated 3 weeks ago
• autonomi-ai / nos
  ⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.
  ☆125Updated 3 months ago
• adarshxs / TokenTally
  Estimate Your LLM's Token Toll Across Various Platforms and Configurations
  ☆28Updated last month
• Paperspace / ml-in-a-box
  Machine learning tool-set for Paperspace VMs
  ☆54Updated 7 months ago
• premAI-io / Ayup
  Quickly and securely turn any Linux box into a build and deployment assistant
  ☆26Updated this week
• jonathandale / chat-ollama
  UI for Ollama
  ☆14Updated last week
• sedwards2009 / llm-multitool
  Web UI for working with large language models
  ☆23Updated 3 months ago
• lancedb / ragged
  ☆10Updated 2 weeks ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆58Updated 2 weeks ago