vLLM fork for Tesla V100 (SM70) with AWQ 4-bit support, CUDA 12.8 build flow, and validated Qwen3.5 27B/35B deployment on multi-GPU V100.
☆131Apr 2, 2026Updated last week
Alternatives and similar repositories for 1Cat-vLLM
Users that are interested in 1Cat-vLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"☆11Mar 31, 2024Updated 2 years ago
- Code for Findings of ACL 2023 paper "Improving Zero-shot Multilingual Neural Machine Translation by Leveraging Cross-lingual Consistency …☆10Jul 18, 2023Updated 2 years ago
- Building a quick conversation-based search demo with langchain.☆10Apr 2, 2024Updated 2 years ago
- Extend bert-nmt to context-aware translation.☆11May 24, 2021Updated 4 years ago
- Continuous Benchmark for cache libraries written in golang.☆12Mar 26, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- machine translation data process tools☆10Apr 29, 2024Updated last year
- 自己写过的爬虫脚本☆12May 11, 2019Updated 6 years ago
- STAR: Similarity-guided Teacher-Assisted Refinement for Super-Tiny Function Calling Models☆42Mar 23, 2026Updated 2 weeks ago
- oyc-lang 自制编程语言☆11Apr 21, 2018Updated 7 years ago
- ☆12Apr 29, 2021Updated 4 years ago
- Simple Interprocess Plugins for Go☆17Mar 24, 2020Updated 6 years ago
- IEEE OUI database as JSON☆18Apr 3, 2026Updated last week
- A Github App to chat with Your GitHub Repo's Issues Using ChatGPT☆17Mar 8, 2023Updated 3 years ago
- a tiny, portable, stackless coroutine in C++11☆11May 17, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- PaddleSeq☆10Mar 28, 2023Updated 3 years ago
- A lightweight tool that efficiently isolates target speaker data from your datasets.☆19Nov 23, 2024Updated last year
- Converts Mandarin Chinese pinyin notation to IPA (international phonetic alphabet) notation☆18Nov 28, 2023Updated 2 years ago
- ☆12Aug 3, 2024Updated last year
- LFU with Dynamic Aging cache library for Golang☆12Nov 24, 2020Updated 5 years ago
- ☆19Jul 20, 2015Updated 10 years ago
- Eagle Files for piMeter EnergyMonitor☆13Sep 3, 2018Updated 7 years ago
- 目前只有阅读理解赛道的☆13Mar 31, 2021Updated 5 years ago
- A lightweight cross-platform real-time audio and video transmission engine | 一个轻量级跨平台实时音视频传输引擎☆134Mar 20, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- This gem wraps command line tools to extract plain text from typical files, such as PDF and common office formats.☆14Nov 25, 2025Updated 4 months ago
- Fixed memory overflow issue in ProcessHider.☆16May 27, 2018Updated 7 years ago
- CogNetX is an advanced, multimodal neural network architecture inspired by human cognition. It integrates speech, vision, and video proce…☆20Mar 30, 2026Updated last week
- Source codes and examples for DeepPrime☆13Dec 17, 2024Updated last year
- Libreoffice extension to convert image to editable document☆18Dec 11, 2016Updated 9 years ago
- 将是一个适用于自动化任务的工作流引擎☆15Mar 11, 2017Updated 9 years ago
- 基于Flask和React实现的网页端云网盘☆16Feb 14, 2020Updated 6 years ago
- android process daemon☆15Apr 30, 2018Updated 7 years ago
- An official implementation of the paper "Addressing Segmentation Ambiguity in Neural Linguistic Steganography"☆14Nov 12, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Persistent Memory Test Suite☆14Apr 29, 2020Updated 5 years ago
- Dynamic data selection for neural machine translation☆20Jan 28, 2018Updated 8 years ago
- A markdown-to-slides generator.☆16Jan 3, 2024Updated 2 years ago
- 🔬【FileICOn】从文件提取图标（支持图片[bmp/gif/jpg/jpeg/jp2/jpeg2000/png/tiff]、图标[ico/icns]、Windows可执行文件[exe/dll]、资源文件[mui/mun]、Linux可执行文件[*.desktop{*.…☆15Nov 17, 2024Updated last year
- TerarkSQL boosts MySQL performance to the next level.☆14Dec 6, 2018Updated 7 years ago
- Vips is fast low-level image processing powered by libvips C library, pure Go, No dependence.☆16Apr 20, 2023Updated 2 years ago
- 这是一个能直接备份Android数据到PC上的命令行工具。☆13Jan 5, 2023Updated 3 years ago