Alternatives and similar repositories for llgtrt

Users that are interested in llgtrt are comparing it to the libraries listed below

• Dan-wanna-M / kbnf
  A high-performance constrained decoding engine based on context free grammar in Rust
  ☆51Updated 4 months ago
• guidance-ai / llguidance
  Super-fast Structured Outputs
  ☆227Updated this week
• Oxen-AI / GRPO-With-Cargo-Feedback
  This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback
  ☆84Updated 2 months ago
• dottxt-ai / outlines-core
  Faster structured generation
  ☆213Updated this week
• beowolx / rensa
  High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…
  ☆82Updated last month
• 567-labs / instructor-rs
  Structured outputs for LLMs
  ☆46Updated 9 months ago
• fbilhaut / gline-rs
  Inference engine for GLiNER models, in Rust
  ☆57Updated last month
• LaurentMazare / mamba.rs
  ☆129Updated last year
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆38Updated last year
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆132Updated 4 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆136Updated 9 months ago
• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆47Updated last month
• chenwanqq / candle-llava
  implement llava using candle
  ☆14Updated 11 months ago
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆80Updated last year
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆75Updated last year
• Dan-wanna-M / formatron
  Formatron empowers everyone to control the format of language models' output with minimal overhead.
  ☆197Updated 4 months ago
• Noveum / ai-gateway
  Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly a…
  ☆64Updated 2 months ago
• jimexist / surya-rs
  Rust implementation of Surya
  ☆58Updated 2 months ago
• FL33TW00D / wattkit
  ☆14Updated 5 months ago
• huggingface / xet-core
  xet client tech, used in huggingface_hub
  ☆92Updated this week
• huggingface / candle-cublaslt
  ☆13Updated last year
• xetdata / xet-core
  Rust crates for XetHub
  ☆43Updated 6 months ago
• EndlessReform / fish-speech.rs
  A Fish Speech implementation in Rust, with Candle.rs
  ☆80Updated 2 months ago
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆40Updated last year
• ShelbyJenkins / llm_utils
  llm_utils: Basic LLM tools, best practices, and minimal abstraction.
  ☆46Updated 2 months ago
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆36Updated last year
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆37Updated this week
• lancedb / tantivy-object-store
  Tantivy directory implementation backed by object_store
  ☆33Updated last year
• kyutai-labs / moshi-webrtc
  Proof of concept for running moshi/hibiki using webrtc
  ☆18Updated 2 months ago
• oxidized-transformers / oxidized-transformers
  Modular Rust transformer/LLM library using Candle
  ☆36Updated last year