kozistr / triton-grpc-proxy-rs

Related projects ⓘ

Alternatives and complementary repositories for triton-grpc-proxy-rs

• ialacol / text-inference-batcher
  A high performance batching router optimises max throughput for text inference workload
  ☆16Updated last year
• ashvardanian / usearch-binary
  Binary vector search example using Unum's USearch engine and pre-computed Wikipedia embeddings from Co:here and MixedBread
  ☆19Updated 7 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆40Updated this week
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆56Updated 10 months ago
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆39Updated 3 months ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆41Updated last month
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆59Updated 5 months ago
• enjalot / fineweb-modal
  Using modal.com to process FineWeb-edu data
  ☆19Updated 2 months ago
• Narsil / bloomserver
  ☆36Updated 2 years ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆54Updated 10 months ago
• raga-ai-hub / ragaai-catalyst
  ☆18Updated this week
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆33Updated 3 weeks ago
• gjreda / scratch-pdf-bot
  Prototyping a question and answer bot over PDFs
  ☆38Updated last year
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆26Updated last year
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆84Updated last month
• aniketmaurya / agents
  Build Agentic workflows with function calling
  ☆20Updated this week
• FalkorDB / falkordb-browser
  FalkorDB-Browser is a visualization UI for FalkorDB.
  ☆20Updated 2 weeks ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆15Updated last month
• charlesfrye / minimodal
  A miniature version of Modal
  ☆18Updated 5 months ago
• voyage-ai / voyageai-python
  Voyage AI Official Python Library
  ☆41Updated 2 weeks ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆23Updated last week
• willkurt / evenflow
  Framework for Self-Organizing Python Agents
  ☆30Updated 9 months ago
• charlesfrye / cuda-substrings
  Because it's there.
  ☆14Updated 2 months ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆63Updated 11 months ago
• NolanoOrg / InstructLLaMa.cpp
  Fast inference of Instruct tuned LLaMa on your personal devices.
  ☆22Updated last year
• sankalp1999 / code_qa
  RAG on codebases using treesitter and LanceDB
  ☆31Updated this week
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆54Updated last month