KerfuffleV2 / llm-samplers

Related projects ⓘ

Alternatives and complementary repositories for llm-samplers

• Narsil / smelte-rs
  ☆57Updated last year
• KerfuffleV2 / smolrsrwkv
  A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit eva…
  ☆92Updated last year
• KGrewal1 / candle-optimisers
  A collection of optimisers for use with candle
  ☆31Updated this week
• KerfuffleV2 / ggml-sys-bleedingedge
  Bleeding edge low level Rust binding for GGML
  ☆16Updated 4 months ago
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆127Updated 3 months ago
• tomsanbear / bitnet-rs
  Implementing the BitNet model in Rust
  ☆28Updated 7 months ago
• EndlessReform / fish-speech.rs
  A Fish Speech implementation in Rust, with Candle.rs
  ☆45Updated this week
• LaurentMazare / glim
  ☆17Updated last month
• mrsteyk / rwkvk-rs
  ☆32Updated last year
• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆37Updated 8 months ago
• Narsil / bindgen_cuda
  ☆19Updated 4 months ago
• wavey-ai / mel-spec
  Rust library for whisper.cpp compatible Mel spectrograms
  ☆58Updated 2 months ago
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆80Updated 10 months ago
• KerfuffleV2 / rusty-ggml
  GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface
  ☆19Updated last year
• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆39Updated last month
• thewh1teagle / sherpa-rs
  Rust bindings to https://github.com/k2-fsa/sherpa-onnx
  ☆45Updated this week
• Narsil / ggblas
  ☆25Updated last year
• edgenai / llama_cpp-rs
  High-level, optionally asynchronous Rust bindings to llama.cpp
  ☆179Updated 5 months ago
• hanabi1224 / RuAnnoy
  Rust port of annoy (https://github.com/spotify/annoy)
  ☆40Updated 2 months ago
• npc-engine / edge-transformers
  Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.
  ☆34Updated last year
• LaurentMazare / ug
  Experimental compiler for deep learning models
  ☆13Updated this week
• gnp / minbpe-rs
  Port of Andrej Karpathy's minbpe to Rust
  ☆19Updated 6 months ago
• KarelPeeters / Kyanite
  A neural network inference library, written in Rust.
  ☆56Updated 4 months ago
• oxideai / diffusers-burn
  A diffusers API in Burn (Rust)
  ☆15Updated 4 months ago
• BDUG / Lighter
  A Keras like abstraction layer on top of the Rust ML framework candle
  ☆22Updated 5 months ago
• nkeenan38 / voice_activity_detector
  A Voice Activity Detector rust library using the Silero VAD model.
  ☆26Updated 2 months ago
• frankfralick / openai-func-enums
  A set of Rust macros for working with OpenAI function/tool calls.
  ☆42Updated 7 months ago
• tomsanbear / candle-einops
  ☆22Updated this week
• rustformers / llmcord
  A Discord bot, written in Rust, that generates responses using the LLaMA language model.
  ☆91Updated last year