Alternatives and similar repositories for pascal-pkgs-ci

Users that are interested in pascal-pkgs-ci are comparing it to the libraries listed below

• cduk / vllm-pascal
  A fork of vLLM enabling Pascal architecture GPUs
  ☆28Updated 3 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆173Updated this week
• sasha0552 / vllm-ci
  CI scripts designed to build a Pascal-compatible version of vLLM.
  ☆12Updated 9 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆519Updated this week
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆181Updated this week
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆203Updated this week
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆385Updated this week
• limcheekin / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆153Updated 10 months ago
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆969Updated this week
• crashr / gppm
  GPU Power and Performance Manager
  ☆58Updated 7 months ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆176Updated last week
• Sumandora / remove-refusals-with-transformers
  Implements harmful/harmless refusal removal using pure HF Transformers
  ☆841Updated 11 months ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆255Updated 3 months ago
• Orion-zhen / abliteration
  Make abliterated models with transformers, easy and fast
  ☆71Updated last month
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆231Updated 3 months ago
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆86Updated last month
• AaronFeng753 / Better-R1
  A open webui function for better R1 experience
  ☆78Updated 2 months ago
• theroyallab / YALS
  ☆71Updated last week
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆118Updated this week
• LeanModels / DFloat11
  DFloat11: Lossless LLM Compression for Efficient GPU Inference
  ☆405Updated last week
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆130Updated 11 months ago
• ssiu / flash-attention-turing
  ☆35Updated this week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆65Updated this week
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆181Updated last year
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆848Updated this week
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆84Updated 6 months ago
• and270 / thinking_effort_processor
  ☆88Updated 2 months ago
• eliranwong / MultiAMDGPU_AIDev_Ubuntu
  Multi AMD GPU Setup for AI Development on Ubuntu with ROCM
  ☆32Updated 2 months ago
• vtuber-plan / olah
  Self-hosted huggingface mirror service. 自建huggingface镜像服务。
  ☆169Updated 3 weeks ago
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆21Updated 2 months ago