Alternatives and similar repositories for llgtrt:

Users that are interested in llgtrt are comparing it to the libraries listed below

• guidance-ai / llguidance
  Super-fast Structured Outputs
  ☆114Updated this week
• beowolx / rensa
  High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…
  ☆78Updated this week
• dottxt-ai / outlines-core
  Faster structured generation
  ☆177Updated this week
• Dan-wanna-M / kbnf
  A high-performance constrained decoding engine based on context free grammar in Rust
  ☆46Updated last month
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆32Updated 9 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆72Updated 2 months ago
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆37Updated last year
• EricLBuehler / zig_ml
  Tensor library for Zig
  ☆11Updated 3 months ago
• instructor-ai / instructor-rs
  Structured outputs for LLMs
  ☆37Updated 7 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆53Updated last year
• mzbac / mlx-lora
  ☆38Updated 11 months ago
• spyglass-search / memex
  Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.
  ☆57Updated last year
• cjpais / whisperfile
  ☆53Updated 6 months ago
• LaurentMazare / glim
  ☆19Updated 4 months ago
• Narsil / smelte-rs
  ☆57Updated last year
• npc-engine / edge-transformers
  Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.
  ☆36Updated last year
• tomsanbear / bitnet-rs
  Implementing the BitNet model in Rust
  ☆30Updated 10 months ago
• jimexist / surya-rs
  Rust implementation of Surya
  ☆57Updated 3 weeks ago
• oxidized-transformers / oxidized-transformers
  Modular Rust transformer/LLM library using Candle
  ☆36Updated 9 months ago
• FL33TW00D / steelix
  Your one stop CLI for ONNX model analysis.
  ☆47Updated 2 years ago
• asg017 / sqlite-rembed
  A SQLite extension for generating text embeddings from remote APIs (OpenAI, Nomic, Ollama, llamafile...)
  ☆108Updated 3 months ago
• ShelbyJenkins / llm_utils
  llm_utils: Basic LLM tools, best practices, and minimal abstraction.
  ☆41Updated this week
• nova-land / gbnf-compiler
  Plug n Play GBNF Compiler for llama.cpp
  ☆24Updated last year
• oxideai / mlx-rs
  Unofficial Rust bindings to Apple's mlx framework
  ☆126Updated this week
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆62Updated last week
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆82Updated 6 months ago
• KerfuffleV2 / smolrsrwkv
  A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit eva…
  ☆93Updated last year
• LaurentMazare / mamba.rs
  ☆125Updated 9 months ago