Alternatives and similar repositories for vram-calculator

Users that are interested in vram-calculator are comparing it to the libraries listed below

• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• character-ai / MuKoe
  ☆53Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 4 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆52Updated 3 months ago
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆100Updated last year
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆28Updated last month
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆122Updated 2 weeks ago
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆28Updated last year
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 3 months ago
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆30Updated last year
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆61Updated 8 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆98Updated 2 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆137Updated this week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆92Updated 2 months ago
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆66Updated 3 months ago
• ivanleomk / modal-grpo
  ☆18Updated last month
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• michaelthwan / llm_family_chart
  LLM family chart
  ☆50Updated last year
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆72Updated this week
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated this week
• NousResearch / StripedHyenaTrainer
  ☆61Updated last year
• guidance-ai / jsonschemabench
  ☆31Updated 3 weeks ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆54Updated 7 months ago
• lechmazur / divergent
  LLM Divergent Thinking Creativity Benchmark. LLMs generate 25 unique words that start with a given letter with no connections to each oth…
  ☆32Updated last month
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 11 months ago