Alternatives and similar repositories for vram-calculator

Users that are interested in vram-calculator are comparing it to the libraries listed below

• llmonpy / needle-in-a-needlestack
  ☆116Updated 6 months ago
• codelion / pts
  Pivotal Token Search
  ☆118Updated 3 weeks ago
• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆51Updated this week
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆31Updated 7 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆82Updated 2 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆130Updated 2 months ago
• QuixiAI / kraken
  ☆66Updated last year
• guidance-ai / jsonschemabench
  ☆51Updated last month
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆101Updated last year
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆61Updated 2 months ago
• substratusai / vllm-docker
  ☆63Updated 4 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆125Updated 2 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆53Updated 8 months ago
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆87Updated 6 months ago
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆88Updated last year
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆139Updated last week
• LAION-AI / AIW
  Alice in Wonderland code base for experiments and raw experiments data
  ☆131Updated last month
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆103Updated 5 months ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆87Updated this week
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆140Updated 5 months ago
• QuixiAI / OpenChatML
  ☆157Updated last year
• teknium1 / ShareGPT-Builder
  ☆115Updated 7 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆81Updated last year
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆28Updated 2 months ago
• emrgnt-cmplxty / zero-shot-replication
  ☆74Updated last year