Alternatives and similar repositories for vram-calculator

Users that are interested in vram-calculator are comparing it to the libraries listed below

• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 5 months ago
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• codelion / pts
  Pivotal Token Search
  ☆104Updated last month
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆127Updated 3 weeks ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆100Updated last year
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆62Updated 10 months ago
• michaelthwan / llm_family_chart
  LLM family chart
  ☆51Updated last year
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated 9 months ago
• mozilla-ai / lm-buddy
  Your buddy in the (L)LM space.
  ☆64Updated 9 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• cognitivecomputations / kraken
  ☆66Updated last year
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆30Updated last year
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆60Updated last year
• teknium1 / transformers-gptq-quant
  ☆47Updated last year
• fairydreaming / lineage-bench
  Testing LLM reasoning abilities with lineage relationship quizzes.
  ☆28Updated 3 months ago
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆87Updated 3 weeks ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated 11 months ago
• charlesfrye / cuda-substrings
  Because it's there.
  ☆16Updated 9 months ago
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆65Updated last year
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year
• Narsil / bloomserver
  ☆39Updated 2 years ago
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆31Updated last year
• llmonpy / needle-in-a-needlestack
  ☆116Updated 4 months ago
• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆21Updated last year
• lightblue-tech / lb-reranker
  ☆23Updated 4 months ago
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• anarchy-ai / llm-speed-benchmark
  Benchmarking tool for assessing LLM models' performance across different hardwares
  ☆17Updated last year
• simonw / llm-command-r
  Access the Cohere Command R family of models
  ☆37Updated 2 months ago
• coreweave / ml-containers
  ☆37Updated this week