☆21Jun 14, 2026Updated 2 months ago
Alternatives and similar repositories for mini-vllm
Users that are interested in mini-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 基于Rust的大模型推理框架☆12Updated this week
- Source code of IPA, https://escholarship.org/uc/item/2p0805dq☆13Jun 27, 2024Updated 2 years ago
- A case study of quantitative modeling for beginners.☆26Jan 26, 2026Updated 6 months ago
- 学习与实践 CUDA Kernel 优化的示例仓库，涵盖矩阵乘法（SGEMM）、矩阵转置、各类归约（sum/max/softmax/矩阵 softmax）、GEMV、逐元素算子、LayerNorm，以及 cuBLAS 对比与若干入门示例。目标是以循序渐进的方式，拆解典型优化…☆29Aug 20, 2025Updated 11 months ago
- Gemma2(9B), Llama3-8B-Finetune-and-RAG, code base for sample, implemented in Kaggle platform☆22Feb 8, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A benchmark to evaluate AI Agents in social domains.☆18Aug 6, 2026Updated last week
- Implementation of LPLR algorithm for matrix compression☆33Nov 21, 2023Updated 2 years ago
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 6 years ago
- MutliAgent Attack☆15Oct 3, 2024Updated last year
- Fast GPU based tensor core reductions☆12Jan 13, 2023Updated 3 years ago
- Nano vLLM☆26Aug 11, 2025Updated last year
- socket program to send data with encryption☆13Jun 1, 2021Updated 5 years ago
- The code for paper "MemGym: a Long-Horizon Memory Environment for LLM Agents".☆21Jun 2, 2026Updated 2 months ago
- Code for the "Deep Learning for Short-Term Traffic Flow Prediction" paper (https://arxiv.org/abs/1604.04527)☆12Apr 12, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- flash attention 优化日志☆32Jun 4, 2025Updated last year
- setup pytorch on android☆12Mar 2, 2020Updated 6 years ago
- Federated Learning - PyTorch☆15Jun 27, 2021Updated 5 years ago
- PySOM - The Simple Object Machine Smalltalk implemented in Python☆18Jun 7, 2026Updated 2 months ago
- inductive reasoning benchmark with subregular hierarchy for string-to-string transformation☆20Jun 27, 2025Updated last year
- GEMM by WMMA (tensor core)☆15Jul 31, 2022Updated 4 years ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 3 years ago
- EmojiCrypt: Prompt Encryption for Secure Communication with Large Language Models☆26Feb 21, 2024Updated 2 years ago
- ☆34Nov 21, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- OTFFT is a high-speed FFT library using the Stockham's algorithm and AVX.☆29Aug 17, 2022Updated 3 years ago
- Experiments with self-supervised learning☆11Mar 9, 2020Updated 6 years ago
- See also APPL: https://github.com/appl-team/appl that improves this project. A Python package for writing Language Models prompts in a ne…☆42Oct 2, 2023Updated 2 years ago
- ☆10Sep 15, 2020Updated 5 years ago
- Official Implementation of "Learning to Refuse: Towards Mitigating Privacy Risks in LLMs"☆10Dec 13, 2024Updated last year
- Vectorized implementation of a general feedforward neural network in Python☆10Jan 22, 2017Updated 9 years ago
- Deep Learning and Natural Language Processing using PyTorch (O'Reilly AI - NYC, 2019)☆11Apr 16, 2019Updated 7 years ago
- Building a dataset of Twitter replies for unsupervised learning / bot-blocking☆13Jul 22, 2020Updated 6 years ago
- Raft transport layer that implements the Redis protocol☆15Nov 3, 2020Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This is a sample project where we can get the exact use case of pythons multi threading.☆11Oct 6, 2020Updated 5 years ago
- A Proof-of-concept CPU profiler written in Go using eBPF☆12Mar 6, 2023Updated 3 years ago
- Code for EMNLP 2020 paper: Analogous Process Structure Induction for Sub-event Sequence Prediction☆11Oct 19, 2020Updated 5 years ago
- Let's learn gradient descent by using linear regression, logistic regression and neural networks!☆12Jan 14, 2019Updated 7 years ago
- Standalone Gemma 4 PyTorch Model using Claude Code☆15Jul 26, 2026Updated 2 weeks ago
- ☆10Jun 6, 2017Updated 9 years ago
- EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！☆40Aug 26, 2024Updated last year