Super fast serving stack for LLM on Windows/Linux/Macos
☆17Dec 17, 2025Updated 7 months ago
Alternatives and similar repositories for sfllm
Users that are interested in sfllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project is primarily used to deploy large language models and multimodal large models on Orin.🚀🚀🚀☆18Jun 23, 2026Updated 3 weeks ago
- Aggressive decode optimizations for Qwen3-0.6B on RTX 5090☆54Feb 25, 2026Updated 4 months ago
- ☆11Mar 9, 2022Updated 4 years ago
- [IPDPS 2024] Adaptive neighbor sampling for temporal GNN☆16Feb 17, 2025Updated last year
- 用pytorch训练18层残差神经网络，用pyqt设计界面☆12Jun 23, 2020Updated 6 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- My learning notes for ML&SYS.☆13Mar 27, 2026Updated 3 months ago
- SC'25 UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling☆16Aug 14, 2025Updated 11 months ago
- ☆27May 12, 2026Updated 2 months ago
- 文档项目☆13Jun 2, 2026Updated last month
- A single-file educational implementation for understanding vLLM's core concepts and running LLM inference.☆45Apr 7, 2026Updated 3 months ago
- InfiniStore: an elastic serverless cloud storage system (VLDB'23)☆25May 5, 2023Updated 3 years ago
- Pure Rust implementation of Google's TurboQuant (ICLR 2026) — KV cache compression for LLMs☆39Apr 19, 2026Updated 3 months ago
- ECAA首届电子商务AI算法大赛☆12Aug 31, 2021Updated 4 years ago
- A comparison of some conformal quantile regression methods.☆12Sep 14, 2019Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- UniDoc-RL: Unified Document Understanding with Reinforcement Learning☆16May 21, 2026Updated 2 months ago
- Facial Attractiveness Prediction via Co-Attention Learning☆16Jul 21, 2020Updated 6 years ago
- Rust development environment based on Docker.☆12Sep 7, 2021Updated 4 years ago
- This project aims to provide a high effective KV cache manage framework for llm inference and improve memory utilization and inference sp…☆67Apr 24, 2026Updated 2 months ago
- 《人工智能程序设计》大作业：吃豆人（成品）☆11Jul 12, 2022Updated 4 years ago
- Open Source Projects from Pallas Lab☆21Oct 10, 2021Updated 4 years ago
- 【TOIS2023】perCLTV: A General System for Personalized Customer Lifetime Value Prediction in Online Games☆11Apr 27, 2023Updated 3 years ago
- Add Disqus to your Jupyter notebook.☆14Feb 14, 2018Updated 8 years ago
- 第二届计图人工智能挑战赛，基于Jittor的草图风景图像生成大赛☆10Jan 28, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Opinionated library for managing hyperparameters and mutable state of machine learning training systems.☆19Aug 4, 2023Updated 2 years ago
- A videogame made with PyGame turned into an Open AI Gym Learning Environment for Reinforcement Learning agents.☆14Jan 3, 2023Updated 3 years ago
- Integrated Tensorforce and OpenAI Gym to train SC II game agents.☆13Oct 26, 2019Updated 6 years ago
- ☆15Jan 25, 2024Updated 2 years ago
- ☆10Feb 20, 2024Updated 2 years ago
- ☆16Mar 24, 2023Updated 3 years ago
- 2021MathorCup高校数学建模挑战赛大数据竞赛B题-遥感地块分割-国家一等奖☆13May 1, 2021Updated 5 years ago
- The official implementation of "Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization"☆16Mar 14, 2024Updated 2 years ago
- ☆13Aug 9, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- RLVR training for LLM in CUDA/C++☆39Jun 8, 2026Updated last month
- SGLang is a fast serving framework for large language models and vision language models.☆35Updated this week
- Android TF-lite App☆15Apr 22, 2020Updated 6 years ago
- 仿效 UNIX 文件管理系统的基于 Django 的网盘☆14Sep 1, 2018Updated 7 years ago
- ☆12Feb 11, 2026Updated 5 months ago
- Fault Localization using hybrid formulae for CS5704: Software Engineering project☆12May 8, 2018Updated 8 years ago
- A Controllable Model of Grounded Response Generation (AAAI 21)☆13Oct 25, 2022Updated 3 years ago