Super fast serving stack for LLM on Windows/Linux/Macos
☆17Sep 18, 2026Updated this week
Alternatives and similar repositories for sfllm
Users that are interested in sfllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project is primarily used to deploy large language models and multimodal large models on Orin.🚀🚀🚀☆18Jun 23, 2026Updated 2 months ago
- Aggressive decode optimizations for Qwen3-0.6B on RTX 5090☆63Feb 25, 2026Updated 6 months ago
- ☆11Mar 9, 2022Updated 4 years ago
- 用pytorch训练18层残差神经网络，用pyqt设计界面☆12Jun 23, 2020Updated 6 years ago
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Jun 22, 2022Updated 4 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- My learning notes for ML&SYS.☆13Mar 27, 2026Updated 5 months ago
- ☆27May 12, 2026Updated 4 months ago
- 文档项目☆13Jun 2, 2026Updated 3 months ago
- Humming is a high-performance, lightweight, and highly flexible JIT (Just-In-Time) compiled GEMM kernel library specifically designed for…☆233Updated this week
- A single-file educational implementation for understanding vLLM's core concepts and running LLM inference.☆45Apr 7, 2026Updated 5 months ago
- ☆28Sep 15, 2024Updated 2 years ago
- InfiniStore: an elastic serverless cloud storage system (VLDB'23)☆24May 5, 2023Updated 3 years ago
- ☆22Nov 25, 2023Updated 2 years ago
- ☆25Jul 8, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- UniDoc-RL: Unified Document Understanding with Reinforcement Learning☆18May 21, 2026Updated 4 months ago
- Pure Rust implementation of Google's TurboQuant (ICLR 2026) — KV cache compression for LLMs☆37Apr 19, 2026Updated 5 months ago
- [ICME 2021 Oral] Official implementation for "FGF-GAN: A Lightweight Generative Adversarial Network for Pansharpening via Fast Guided Fil…☆11Mar 29, 2022Updated 4 years ago
- Rust development environment based on Docker.☆12Sep 7, 2021Updated 5 years ago
- 动手学ROS2系列教程☆16Aug 26, 2021Updated 5 years ago
- This project aims to provide a high effective KV cache manage framework for llm inference and improve memory utilization and inference sp…☆75Apr 24, 2026Updated 4 months ago
- The official implement of Freeze-Omni.☆16Jul 10, 2025Updated last year
- Opinionated library for managing hyperparameters and mutable state of machine learning training systems.☆19Aug 4, 2023Updated 3 years ago
- 第二届计图人工智能挑战赛，基于Jittor的草图风景图像生成大赛☆10Jan 28, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Facial Attractiveness Prediction via Co-Attention Learning☆17Jul 21, 2020Updated 6 years ago
- Integrated Tensorforce and OpenAI Gym to train SC II game agents.☆13Oct 26, 2019Updated 6 years ago
- 无需配置特定环境，在 Docker 容器环境中编译 linux-2.6.26，并在宿主机的 qemu 中运行☆16Jul 16, 2024Updated 2 years ago
- ☆16Mar 24, 2023Updated 3 years ago
- Build a Real-Time Slack Clone With Nextjs, React, Tailwind, Auth.js | Code with Antonio☆16Sep 19, 2024Updated 2 years ago
- The official implementation of "Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization"☆16Mar 14, 2024Updated 2 years ago
- ☆12Jul 4, 2024Updated 2 years ago
- RLVR training for LLM in CUDA/C++☆42Jul 25, 2026Updated last month
- SGLang is a fast serving framework for large language models and vision language models.☆35Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆13Aug 12, 2026Updated last month
- A Controllable Model of Grounded Response Generation (AAAI 21)☆13Oct 25, 2022Updated 3 years ago
- Unsupervised Key-phrase Extraction and Clustering for Classification Scheme in Scientific Publications.☆19May 24, 2021Updated 5 years ago
- ☆18Oct 3, 2023Updated 2 years ago
- Open Source Projects from Pallas Lab☆21Oct 10, 2021Updated 4 years ago
- TIER: Text-Image Encoder-based Regression for AIGC Image Quality Assessment☆10Mar 1, 2025Updated last year
- ☆12Updated this week