okuvshynov / llama_duoView external linksLinks
asynchronous/distributed speculative evaluation for llama3
☆40Aug 8, 2024Updated last year
Alternatives and similar repositories for llama_duo
Users that are interested in llama_duo are comparing it to the libraries listed below
Sorting:
- ☆30Dec 23, 2024Updated last year
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- Stable Diffusion in TensorRT 8.5+☆15Mar 19, 2023Updated 2 years ago
- monodepth running in Android by ncnn☆23Oct 12, 2021Updated 4 years ago
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated last year
- TensorRT实现BiSeNetV1与BiSeNetV2部署☆20Apr 14, 2022Updated 3 years ago
- 📈Implementing the ADAM optimizer from the ground up with PyTorch and comparing its performance on six 3-D objective functions (each prog…☆22Jul 2, 2022Updated 3 years ago
- ☆22Apr 10, 2024Updated last year
- minimal C implementation of speculative decoding based on llama2.c☆25Jul 15, 2024Updated last year
- ☆20Dec 29, 2023Updated 2 years ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Nov 11, 2024Updated last year
- Testing LLM reasoning abilities with family relationship quizzes.☆63Jan 28, 2025Updated last year
- An implementation of Deepmind's Promptbreeder.☆22Dec 22, 2023Updated 2 years ago
- Examples of AI model running on the board, such as horizon/rockchip and so on.☆21Jul 10, 2023Updated 2 years ago
- A friendly Zig launcher and toolchain manager.☆22Dec 2, 2025Updated 2 months ago
- Llama3 Streaming Chat Sample☆22Apr 24, 2024Updated last year
- Solana Airdrop Faucet: A simple web application that allows users to receive free SOL tokens on the Solana Devnet. Built with Next.js, th…☆11Sep 22, 2024Updated last year
- DINOv2 inference engine written in C/C++ using ggml and OpenCV.☆88May 6, 2025Updated 9 months ago
- A live multiplayer trivia game where users can bid for the subject of the next question☆29Jan 9, 2026Updated last month
- Inference of Mamba and Mamba2 models in pure C☆196Jan 22, 2026Updated 3 weeks ago
- ☆28Feb 9, 2024Updated 2 years ago
- ☆16Apr 20, 2025Updated 9 months ago
- segment-anything based mnn☆36Dec 13, 2023Updated 2 years ago
- ☆23Jan 19, 2026Updated 3 weeks ago
- Chaucha functions for usage with Github Actions☆11Sep 18, 2020Updated 5 years ago
- 4D Miner C++ Modding Headers / 4D-Modding API Headers☆12Dec 31, 2025Updated last month
- This project is intended to build and deploy an SNPE model on Qualcomm Devices, which are having unsupported layers which are not part of…☆10Oct 4, 2021Updated 4 years ago
- ppstructure deploy by ncnn☆35Jul 16, 2024Updated last year
- A tiny, didactical implementation of LLAMA 3☆42Dec 2, 2024Updated last year
- cuda编程学习入门☆38Jul 22, 2024Updated last year
- Reinforcement learning with VizDoom platform☆11Apr 18, 2022Updated 3 years ago
- ☆10Dec 24, 2021Updated 4 years ago
- Experimental framework taking inspiration from biological systems, combining compression-based architectures, group theory, and symmetry …☆14Nov 13, 2025Updated 3 months ago
- This project is used to automatically grab the query results of ChatGPT in batches without manual input. And it supports automatic switch…☆14Feb 28, 2023Updated 2 years ago
- 使用ONNXRuntime部署一种用于边缘检测的轻量级密集卷积神经网络LDC，包含C++和Python两个版本的程序☆11Apr 24, 2023Updated 2 years ago
- Music tracker based on Octamed and fasttracker.☆13Jan 13, 2026Updated last month
- dumb video editor. based on openshit☆10Jun 16, 2022Updated 3 years ago
- A Playwright MCP package in Nix☆17Jan 16, 2026Updated last month
- 2D physics engine☆11Jan 12, 2023Updated 3 years ago