Alternatives and similar repositories for llgtrt:

Users that are interested in llgtrt are comparing it to the libraries listed below

• guidance-ai / llguidance
  Super-fast Structured Outputs
  ☆171Updated this week
• Oxen-AI / GRPO-With-Cargo-Feedback
  This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback
  ☆75Updated 3 weeks ago
• beowolx / rensa
  High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…
  ☆80Updated last month
• Dan-wanna-M / kbnf
  A high-performance constrained decoding engine based on context free grammar in Rust
  ☆48Updated 3 months ago
• spyglass-search / memex
  Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.
  ☆58Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆76Updated 3 months ago
• TheProxyCompany / proxy-structuring-engine
  Guaranteed structured outputs from any language model. Eliminate 100% of schema violations and state tracking failures in your LLM applic…
  ☆120Updated this week
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆37Updated last year
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• ialacol / text-inference-batcher
  A high performance batching router optimises max throughput for text inference workload
  ☆16Updated last year
• LaurentMazare / mamba.rs
  ☆126Updated 11 months ago
• npc-engine / edge-transformers
  Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.
  ☆38Updated 2 years ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆187Updated last year
• apehex / tokun
  Tokun to can tokens
  ☆16Updated last month
• flawedmatrix / mamba-ssm
  Implementation of mamba with rust
  ☆85Updated last year
• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆68Updated last month
• jimexist / surya-rs
  Rust implementation of Surya
  ☆57Updated last month
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆79Updated last year
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆38Updated last year
• Vaibhavs10 / fast-llm.rs
  ☆137Updated last year
• dottxt-ai / outlines-core
  Faster structured generation
  ☆198Updated this week
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆155Updated 5 months ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• JackMatthewRimmer / rust-rag-toolchain
  Library for doing RAG
  ☆70Updated last week
• mzbac / mlx-lora
  ☆38Updated last year
• deepgrove-ai / Bonsai
  ☆17Updated last week
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆65Updated last month
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆34Updated 10 months ago
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 6 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆87Updated 8 months ago