Alternatives and similar repositories for vram-calculator:

Users that are interested in vram-calculator are comparing it to the libraries listed below

• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• character-ai / MuKoe
  ☆52Updated 9 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated 11 months ago
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆58Updated last month
• cognitivecomputations / kraken
  ☆65Updated 8 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆29Updated 4 months ago
• laramohan / wikillm
  LLMs as Collaboratively Edited Knowledge Bases
  ☆43Updated 11 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 8 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆88Updated this week
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆101Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆74Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆28Updated 3 weeks ago
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆28Updated 7 months ago
• geov-ai / geov
  The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…
  ☆121Updated last year
• facebookresearch / dual-system-for-visual-language-reasoning
  Github repo for Peifeng's internship project
  ☆13Updated last year
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆29Updated last year
• lechmazur / confabulations
  Hallucinations (Confabulations) Document-Based Benchmark for RAG
  ☆65Updated last week
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆18Updated 2 weeks ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated last year
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆20Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆53Updated 11 months ago
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆63Updated last year
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 3 months ago
• joey00072 / microjax
  Jax like function transformation engine but micro, microjax
  ☆30Updated 3 months ago
• llmonpy / needle-in-a-needlestack
  ☆112Updated this week
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆27Updated 10 months ago