Alternatives and similar repositories for vram-calculator

Users that are interested in vram-calculator are comparing it to the libraries listed below

• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆52Updated last month
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆31Updated 9 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆101Updated last year
• codelion / pts
  Pivotal Token Search
  ☆126Updated 2 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆89Updated 4 months ago
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆181Updated this week
• substratusai / vllm-docker
  ☆64Updated 6 months ago
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
  ☆79Updated this week
• llmonpy / needle-in-a-needlestack
  ☆116Updated 8 months ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆61Updated 2 weeks ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆65Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆133Updated 4 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 7 months ago
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆139Updated 4 months ago
• firstbatchxyz / function-calling-eval
  The DPAB-α Benchmark
  ☆31Updated 8 months ago
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆88Updated last year
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆150Updated last week
• AlexBodner / How_Much_VRAM
  ☆102Updated last year
• QuixiAI / kraken
  ☆67Updated last year
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 8 months ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 11 months ago
• lightblue-tech / lb-reranker
  ☆23Updated 8 months ago
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆55Updated last year
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆138Updated last year
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆65Updated last year
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆56Updated 10 months ago
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆87Updated 8 months ago