Alternatives and similar repositories for vram-calculator

Users that are interested in vram-calculator are comparing it to the libraries listed below

• QuixiAI / kraken
  ☆68Updated last year
• llmonpy / needle-in-a-needlestack
  ☆115Updated 10 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆124Updated 10 months ago
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆53Updated 2 years ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆69Updated 3 weeks ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆137Updated 6 months ago
• dropbox / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆53Updated 3 months ago
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆151Updated 6 months ago
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆65Updated 2 years ago
• AlexBodner / How_Much_VRAM
  ☆101Updated last year
• codelion / pts
  Pivotal Token Search
  ☆132Updated last week
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆32Updated 11 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆161Updated 2 weeks ago
• substratusai / vllm-docker
  ☆66Updated 8 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated last month
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆103Updated 6 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆104Updated last year
• QuixiAI / OpenChatML
  ☆164Updated 4 months ago
• attentionmech / smolbox
  smolbox of recipies
  ☆28Updated 7 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆139Updated last year
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 9 months ago
• Nearcyan / papers.day
  papers.day
  ☆91Updated last year
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆91Updated last year
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆93Updated 9 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆56Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆194Updated last year
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆182Updated 6 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆226Updated last year
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆143Updated 8 months ago