llama.cpp fork for significantly improved performance on Ampere (especially RTX 3090 / 3090 Ti): TurboQuant KV cache, MTP speculative decoding with a 64K draft-vocabulary shortlist, custom SM86 + Qwen kernels. 90 tok/s over a 100K-token generation at temperature 1.
☆95Sep 18, 2026Updated this week
Alternatives and similar repositories for llamAmpere
Users that are interested in llamAmpere are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Aug 15, 2024Updated 2 years ago
- A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchma…☆950Aug 14, 2026Updated last month
- Linux kernel source for HiSTB☆23Aug 6, 2020Updated 6 years ago
- Managed .Net (.NET 8 and .NET 10) compatible ChaCha20 Cipher implementation (encryption and decryption) in C#☆20Jun 30, 2026Updated 2 months ago
- ESP-IDF components written in C++ that can be included in ESP-IDF projects☆13Jun 30, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Stack Exchange for Urbit☆13Aug 26, 2023Updated 3 years ago
- A Qubes OS Salt configuration for building a minimal, reproducible template VM providing the `safe-tx-hashes-util` and Foundry toolchain.☆16Aug 29, 2026Updated 3 weeks ago
- ☆17Mar 28, 2025Updated last year
- Write terminal interfaces with Sail☆21Feb 24, 2026Updated 6 months ago
- C++ build tool☆26Jan 13, 2023Updated 3 years ago
- A promotional animation showcasing Claude Code's sub agent team capabilities, inspired by Greg Isenberg's tweet about AI agent teams and …☆19Jul 28, 2025Updated last year
- Resurrect processes if they die.☆18Feb 25, 2014Updated 12 years ago
- Searchable rich-text notes for techs. One encrypted notepad instead of 80 Notepad tabs: SQLite FTS5 search, SQLCipher protection, wikilin…☆33Sep 9, 2026Updated last week
- A lightweight, high-performance file storage API that uses Telegram as an infinite backend. Perfect for small projects, CDN-like media se…☆52Jan 23, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Time travelling relational database engine and urQL (SQL derived) scripting for the Urbit computer☆37Updated this week
- Koel Labs innovates open-source speech research, inclusive speech technologies, and real-time pronunciation feedback for language learner…☆14Jul 13, 2026Updated 2 months ago
- Generate list of x/y/z Spherical Mercator tiles based on a bounding box and a zoom level.☆33Jan 23, 2015Updated 11 years ago
- Anyfile Opener with Magic-byte MIME Detection and URI Permission Bridging☆18Jul 13, 2026Updated 2 months ago
- 🍊☁️ Open-source* apps that replace a SaaS product, running in your own Cloudflare account☆633Updated this week
- A Node.js-based SFTP server with an integrated REST API for querying users / files.☆24Oct 15, 2020Updated 5 years ago
- ☆18Dec 17, 2020Updated 5 years ago
- Template for vercel-shorturl.☆10Apr 7, 2023Updated 3 years ago
- ☆32Aug 5, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- An MCP-enabled Qwen3 0.6B demo with adjustable thinking budget, all in your browser!☆28Jun 2, 2025Updated last year
- HiSTBLinuxV100R005C00SPC050☆37Feb 27, 2022Updated 4 years ago
- Get user data and posts by scraping Instagram's user page. Without any API keys or oAuths!☆10Jan 7, 2023Updated 3 years ago
- 90-day Biohacker Challenge: An open-sourced biohacking & quantified-self protocol☆11Sep 10, 2016Updated 10 years ago
- Separated binary package of FFmpegOut Unity plugin☆23Oct 31, 2018Updated 7 years ago
- A powerful example for a hotel reservation system with React.js, Redux, Sagas, TypeScript, Custom Validation, Custom Hooks, and much more…☆13Aug 25, 2022Updated 4 years ago
- ☆11Dec 22, 2023Updated 2 years ago
- This repository provides custom modes tailored for each subtask within the SPARC Orchestration framework. It streamlines complex projects…☆26Apr 8, 2025Updated last year
- The BABEL codec - a certified two-way dictionary between GPT-2's internal state and plain English. Paper + frozen artifacts + verdict-bea…☆32Jul 12, 2026Updated 2 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- 🌌Simple multi-purpose data set for PostgreSQL☆12Jul 29, 2018Updated 8 years ago
- Utility to convert between various subscription format☆46Apr 27, 2025Updated last year
- Css stylesheet inspired by Tesla Cybertruck☆14Nov 27, 2019Updated 6 years ago
- Develop software using AI Agent teams (CrewAI framework)☆19Jul 3, 2025Updated last year
- Repository featuring fine-tuning code for various LLMs, complemented by occasional explanations, deep dives.☆42Sep 13, 2024Updated 2 years ago
- BTC Markets Javascript API client☆34Dec 7, 2022Updated 3 years ago
- 机械革命蛟龙P黑苹果的EFI，会持续更新。☆11Aug 7, 2024Updated 2 years ago