Alternatives and similar repositories for vram-calculator:

Users that are interested in vram-calculator are comparing it to the libraries listed below

• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 10 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆43Updated last week
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆91Updated 2 weeks ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated 3 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 2 months ago
• llmonpy / needle-in-a-needlestack
  ☆112Updated last month
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆108Updated 2 weeks ago
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆128Updated 2 weeks ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year
• SLAM-group / newhope
  ☆22Updated last year
• charlesfrye / cuda-substrings
  Because it's there.
  ☆15Updated 6 months ago
• stanford-futuredata / Megatron-LM
  Ongoing research training transformer models at scale
  ☆35Updated last year
• ezyang / ai-blindspots
  Blindspots in LLMs I've noticed while AI coding. Sonnet family emphasis.
  ☆11Updated this week
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆70Updated last month
• xjdr-alt / muzero_sketch
  ☆38Updated 7 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 5 months ago
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆31Updated 3 weeks ago
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆58Updated last year
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆38Updated last year
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆65Updated last month
• langfuse / oss-llmops-stack
  Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…
  ☆89Updated last month
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• lechmazur / confabulations
  Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
  ☆116Updated this week
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆51Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆87Updated 7 months ago
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year