Alternatives and similar repositories for triton-grpc-proxy-rs

Users that are interested in triton-grpc-proxy-rs are comparing it to the libraries listed below

• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated last year
• ialacol / text-inference-batcher
  A high performance batching router optimises max throughput for text inference workload
  ☆16Updated last year
• recmo / cria
  Tiny inference-only implementation of LLaMA
  ☆93Updated last year
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆75Updated last year
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 10 months ago
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆101Updated last year
• oKatanaaa / kolibrify
  Curriculum training of instruction-following LLMs with Unsloth
  ☆14Updated 4 months ago
• teknium1 / transformers-gptq-quant
  ☆47Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 4 months ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated last year
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆74Updated last year
• QuixiAI / kraken
  ☆66Updated last year
• LaurentMazare / mamba.rs
  ☆130Updated last year
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆38Updated 2 years ago
• ashvardanian / jaccard-index
  Optimizing bit-level Jaccard Index and Population Counts for large-scale quantized Vector Search via Harley-Seal CSA and Lookup Tables
  ☆20Updated 2 months ago
• flawedmatrix / mamba-ssm
  Implementation of mamba with rust
  ☆88Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 6 months ago
• BBischof / yapping
  Verbosity control for AI agents
  ☆64Updated last year
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 10 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆64Updated 2 months ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated 2 years ago
• firstbatchxyz / function-calling-eval
  The DPAB-α Benchmark
  ☆29Updated 6 months ago
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 5 months ago
• Vaibhavs10 / fast-llm.rs
  ☆137Updated last year
• lightblue-tech / lb-reranker
  ☆23Updated 6 months ago
• beowolx / rensa
  High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…
  ☆193Updated 3 weeks ago