LaurentMazare / mamba.rs

Related projects: ⓘ

• Vaibhavs10 / fast-llm.rs
  ☆134Updated 7 months ago
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆36Updated last year
• EricLBuehler / candle-vllm
  Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
  ☆229Updated 3 weeks ago
• beowolx / rensa
  High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…
  ☆59Updated last month
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆124Updated 3 weeks ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆97Updated 4 months ago
• ToluClassics / candle-tutorial
  Tutorial for Porting PyTorch Transformer Models to Candle (Rust)
  ☆235Updated last month
• huggingface / hf-hub
  Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package
  ☆138Updated 3 weeks ago
• Narsil / smelte-rs
  ☆57Updated last year
• Dan-wanna-M / kbnf
  A high-performance constrained decoding engine based on context free grammar in Rust
  ☆30Updated this week
• oxideai / mlx-rs
  Unofficial Rust bindings to Apple's mlx framework
  ☆52Updated last week
• chenwanqq / candle-llava
  implement llava using candle
  ☆12Updated 3 months ago
• santiagomed / orca
  LLM Orchestrator built in Rust
  ☆261Updated 6 months ago
• nreHieW / r-nn
  Tensor library with autograd using only Rust's standard library
  ☆61Updated 2 months ago
• cognitivecomputations / spectrum
  ☆75Updated 3 weeks ago
• gaxler / llama2.rs
  Inference Llama 2 in one file of pure Rust 🦀
  ☆227Updated last year
• tomsanbear / candle-einops
  ☆22Updated 2 months ago
• Narsil / hf-chat
  ☆25Updated 8 months ago
• Narsil / fast_gpt2
  ☆152Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆176Updated 6 months ago
• TilliFe / Infermo
  Tensors and dynamic Neural Networks in Mojo
  ☆125Updated last month
• nogibjj / candle-cookbook
  Cookbook to build Rust Candle models
  ☆71Updated 9 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆217Updated 2 months ago
• coreylowman / llama-dfdx
  LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
  ☆100Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆118Updated 2 months ago
• edgenai / llama_cpp-rs
  High-level, optionally asynchronous Rust bindings to llama.cpp
  ☆161Updated 3 months ago
• cognitivecomputations / grokadamw
  ☆109Updated last month
• KGrewal1 / candle-optimisers
  A collection of optimisers for use with candle
  ☆29Updated last month
• poudels14 / llama2_rs_old
  ☆23Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year