kozistr / triton-grpc-proxy-rs

Related projects: ⓘ

• abetlen / program-constrained-language-model-sampling
  ☆34Updated last year
• recmo / cria
  Tiny inference-only implementation of LLaMA
  ☆91Updated 5 months ago
• OrenLeung / Instruct_Prompt_Dataset_Generator
  ☆43Updated this week
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆53Updated 8 months ago
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆72Updated last year
• NousResearch / StripedHyenaTrainer
  ☆55Updated 9 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆68Updated 7 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated last year
• charlesfrye / minimodal
  A miniature version of Modal
  ☆18Updated 3 months ago
• teknium1 / transformers-gptq-quant
  ☆48Updated 11 months ago
• thesephist / spectre
  Sparse autoencoders for Contra text embedding models
  ☆24Updated 4 months ago
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆71Updated 11 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆117Updated 8 months ago
• richardanaya / gbnf
  A library for working with GBNF files
  ☆19Updated 8 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆97Updated 4 months ago
• adarshxs / TokenTally
  Estimate Your LLM's Token Toll Across Various Platforms and Configurations
  ☆28Updated last month
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆63Updated 9 months ago
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆70Updated 7 months ago
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆60Updated 4 months ago
• mrcolo / longboii
  ☆19Updated last year
• willkurt / evenflow
  Framework for Self-Organizing Python Agents
  ☆30Updated 7 months ago
• Birch-san / llama-play
  Command-line script for inferencing from models such as LLaMA, in a chat scenario, with LoRA adaptations
  ☆33Updated last year
• cognitivecomputations / kraken
  ☆64Updated 3 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆25Updated 11 months ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆67Updated last year
• gbt42 / redactAI
  Private inference over your sensitive data with off-the-shelf models
  ☆34Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆35Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated 8 months ago
• lachlansneff / sparsellama
  ☆40Updated last year
• teknium1 / stanford_alpaca-replit
  Modified Stanford-Alpaca Trainer for Training Replit's Code Model
  ☆40Updated last year