Alternatives and similar repositories for vram-calculator:

Users that are interested in vram-calculator are comparing it to the libraries listed below

• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 3 months ago
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• Nero10578 / LLM-Inference-Benchmark
  ☆14Updated 7 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• mrconter1 / human-level-agi-definition
  ☆29Updated 3 months ago
• Alignment-Lab-AI / Our-Projects
  A repository of projects and datasets under active development by Alignment Lab AI
  ☆22Updated last year
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆26Updated 2 weeks ago
• autonomi-ai / nos
  ⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.
  ☆140Updated 10 months ago
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆25Updated 9 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆136Updated 8 months ago
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆29Updated last year
• lechmazur / confabulations
  Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
  ☆121Updated this week
• teknium1 / ShareGPT-Builder
  ☆112Updated 3 months ago
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆131Updated last week
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated 3 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 6 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆95Updated last month
• character-ai / MuKoe
  ☆53Updated 11 months ago
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆87Updated 8 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆102Updated this week
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆107Updated 2 months ago
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆109Updated last month
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 2 months ago
• HazyResearch / train-tk
  train with kittens!
  ☆56Updated 5 months ago
• apple / ml-recurrent-drafter
  ☆207Updated 2 months ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated 10 months ago