Alternatives and similar repositories for open-gpu-kernel-modules

Users that are interested in open-gpu-kernel-modules are comparing it to the libraries listed below

• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆133Updated last week
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆163Updated last year
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆42Updated 2 weeks ago
• ReinForce-II / mmapeak
  ☆43Updated 5 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆82Updated last week
• chigkim / Ollama-MMLU-Pro
  ☆100Updated last month
• Viceman256 / TensorTune
  KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning
  ☆27Updated 4 months ago
• SicariusSicariiStuff / SLOP_Detector
  SLOP Detector and analyzer based on dictionary for shareGPT JSON and text
  ☆74Updated 10 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆202Updated this week
• jd-3d / SOLOBench
  ☆133Updated 4 months ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆80Updated last year
• theroyallab / YALS
  ☆83Updated this week
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆159Updated 4 months ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆197Updated last month
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆95Updated last year
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆124Updated 6 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆499Updated this week
• lechmazur / step_game
  Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…
  ☆73Updated 3 weeks ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆75Updated 11 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆63Updated 7 months ago
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆146Updated 3 months ago
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆83Updated 4 months ago
• firstbatchxyz / function-calling-eval
  The DPAB-α Benchmark
  ☆29Updated 8 months ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆260Updated 6 months ago
• matteoserva / GraphLLM
  ☆209Updated 2 weeks ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆95Updated 2 months ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆61Updated 11 months ago
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• Lanerra / saga
  Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.
  ☆78Updated this week
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆107Updated last year