A compact pipeline for local LLM inference.
☆11Sep 30, 2024Updated 2 years ago
Alternatives and similar repositories for solomonoff
Users that are interested in solomonoff are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MCRT for 'pixellax' film☆15Oct 1, 2024Updated 2 years ago
- Native MacOS dictation that captures audio, transcribes speech, and formats it into clean text. It supports shortcuts, learning, and tone…☆11Feb 18, 2026Updated 8 months ago
- Experimenting with smaller LLMs that can run on commodity hardware like Raspberry Pi as personal assistant☆11Feb 6, 2024Updated 2 years ago
- Throughput-oriented multi-turn inference engine for KernelBench [ICML '25]☆25May 27, 2025Updated last year
- Implementation of Model-Distributed Inference for Large Language Models, built on top of LitGPT☆16Aug 26, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Official implementation of IEEE S&P 2025 paper "Prompt Inversion Attack against Collaborative Inference of Large Language Models"☆17Apr 27, 2025Updated last year
- A collection of exercises for practicing what is taught in Genki: An Integrated Course in Elementary Japanese.☆36Sep 12, 2025Updated last year
- The implementation of paper : RTCoInfer: Real-time Edge-Cloud Collaborative CNN Inference for Stream Analytics on Ubiquitous Images☆17Oct 18, 2022Updated 4 years ago
- SE 350: Operating Systems☆31Jun 20, 2023Updated 3 years ago
- Computer vision based hand gesture controlled mouse pad and volume controller for the Windows OS with speech to text typing functionality☆26Oct 19, 2021Updated 5 years ago
- [COLM'25] CITER: Collaborative Inference for Efficient Large Language Model Decoding with Token-Level Routing☆23Jun 25, 2025Updated last year
- PyTorch implementation of the paper: Decomposing Vision Transformers for Collaborative Inference in Edge Devices☆18Jul 27, 2024Updated 2 years ago
- video editor with semantic search & ai transitions☆112Jan 29, 2026Updated 9 months ago
- CrowdLlama is a distributed system that leverages the open-source Ollama project to run LLM inference tasks across multiple nodes using p…☆31Nov 27, 2025Updated 11 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- List of Canadian tech companies that are hiring interns for 2025☆64Oct 1, 2024Updated 2 years ago
- Code for paper "JMDC: A Joint Model and Data Compression System for Deep Neural Networks Collaborative Computing in Edge-Cloud Networks"☆26Oct 8, 2026Updated 3 weeks ago
- The backend for Lodestone, A free, open source server hosting tool for Minecraft and other multiplayers☆58Jun 21, 2024Updated 2 years ago
- go语言，gin和gorm框架，vue，前后端分离的博客项目，适合初学者学习go后端☆28Oct 24, 2022Updated 4 years ago
- Jupiter is a fast, scalable, and resource-efficient collaborative edge-AI system for generative LLM inference.☆33Jul 3, 2026Updated 4 months ago
- Download all of the content from the University of Waterloo's Desire2Learn LMS☆30Jan 10, 2016Updated 10 years ago
- PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices☆44Jan 31, 2024Updated 2 years ago
- PyTorch implementation of the paper: Multi-Agent Collaborative Inference via DNN Decoupling: Intermediate Feature Compression and Edge Le…☆46Oct 26, 2023Updated 3 years ago
- Autodidactic Neurosurgeon Collaborative Deep Inference for Mobile Edge Intelligence via Online Learning☆43Aug 14, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 云边协同- collaborative inference📚Dynamic adaptive DNN surgery for inference acceleration on the edge☆45Jul 30, 2023Updated 3 years ago
- An Efficient and Versatile Inference Engine for Distributed LLM Serving☆74Updated this week
- C++ Command Line Parser Toolkit☆39Sep 26, 2026Updated last month
- Distributed Inference for mlx LLm☆105Aug 1, 2024Updated 2 years ago
- A cross-platform monotonic clock that is suspend-unaware, written in Rust!☆82May 14, 2025Updated last year
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆54Oct 29, 2025Updated last year
- Metal Accelerated Ray Tracing☆55Apr 8, 2021Updated 5 years ago
- A github repo containing internship opportunities targeting freshman/sophomores and underrepresented minorities in CS☆110Jan 15, 2025Updated last year
- 锂日历记事本-Gin后端项目，基于go语言Gin框架开发☆109Jan 24, 2026Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 云边协同- collaborative inference 📚Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge☆112Jul 29, 2023Updated 3 years ago
- A tool that facilitates easy, efficient and high-quality fine-tuning of Cohere's models☆83Mar 14, 2025Updated last year
- [EGSR2020] Real-time Monte Carlo Denoising with the Neural Bilateral Grid☆72Sep 5, 2022Updated 4 years ago
- DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference☆160Mar 25, 2022Updated 4 years ago
- Acoustic Field simulation for phased-array controllers☆200May 20, 2025Updated last year
- Or: How I Learned to Stop Worrying and Love the Greenback☆176Oct 23, 2022Updated 4 years ago
- Animated onboarding in SwiftUI from my app crAion☆244Jun 26, 2024Updated 2 years ago