☆17Mar 20, 2026Updated 7 months ago
Alternatives and similar repositories for Auto-Inference
Users that are interested in Auto-Inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A tiny scalar-valued autograd engine and neural network library (Karpathy course)☆12Mar 16, 2026Updated 8 months ago
- Callytics is an advanced call analytics solution that leverages speech recognition and large language models (LLMs) technologies to analy…☆89Apr 7, 2025Updated last year
- Inference Llama 2 in one file of pure Haskell (A port of llama2.c from Andrej Karpathy)☆14Oct 17, 2025Updated last year
- Turkish LM Tuner☆87Nov 17, 2024Updated 2 years ago
- 33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU☆15May 5, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Awaken adapts half-duplex FunAudioChat for full-duplex conversation using only a small amount of dialogue data.☆14Nov 9, 2026Updated last week
- ☆14Nov 1, 2026Updated 2 weeks ago
- ☆13Aug 5, 2026Updated 3 months ago
- Local fine-tuning through selective neurons☆15Nov 1, 2026Updated 2 weeks ago
- Implementation for IceCache: Memory-Efficient KV-cache Management for Long-Sequence LLMs (ICLR 2026).☆25Jun 9, 2026Updated 5 months ago
- Distillation pipeline from pretrained Transformers to customized FLA models☆13Aug 4, 2025Updated last year
- ☆200Jun 22, 2025Updated last year
- ☆10May 19, 2022Updated 4 years ago
- AI Chess teacher☆18Jan 5, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆96Jun 20, 2025Updated last year
- Main folder of ros2 project of SBEM robot☆14Updated this week
- ☆14Sep 4, 2024Updated 2 years ago
- Stable Diffusion in TensorRT 8.5+☆14Mar 19, 2023Updated 3 years ago
- AMD PACE is a PyTorch extension for high-performance LLM inference on AMD CPUs. It provides a framework to develop and test novel optimiz…☆18Oct 21, 2026Updated 3 weeks ago
- 机器人人工智能,优达学城cs373作业。 Artificial Intelligence for Robotics, this repository contains all the homework…☆12Nov 12, 2017Updated 9 years ago
- ☆97Nov 6, 2024Updated 2 years ago
- GPU peer-to-peer over dynamic BAR1 for GeForce cards: patched NVIDIA open kernel modules.☆26Nov 6, 2026Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆13Apr 14, 2026Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- XTU = X Transformers Unity — hybrid (CPU-expert + GPU) inference acceleration for vLLM: mainline plugin + CPU MoE engine (AVX512-VNNI/BF1…☆16Nov 2, 2026Updated 2 weeks ago
- [ECCV2024] The code of "SHERL: Synthesizing High Accuracy and Efficient Memory for Resource-Limited Transfer Learning"☆10Oct 15, 2024Updated 2 years ago
- StrongSort-Pip: Packaged version of StrongSort☆10Sep 3, 2022Updated 4 years ago
- A Redis-based Human-in-the-Loop implementation for Haystack Agents, integrated with Open WebUI for interactive tool approval workflows.☆11Jul 24, 2026Updated 3 months ago
- Official PyTorch implementation of "Text2Chart31: Instruction Tuning for Chart Generation with Automatic Feedback" (EMNLP 2024 Main Oral)☆26Oct 15, 2024Updated 2 years ago
- MacOS dragging helper☆12Mar 31, 2024Updated 2 years ago
- One-step Turkish text-to-speech trained with a drifting objective (Kyutai learned-temperature recipe)☆28Updated this week
- Implementing C-RADIOv4 as a Remote Source Zoo Model for FiftyOne☆19Feb 4, 2026Updated 9 months ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆33Nov 16, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ChatGptHub: Gpt Chatbot Library with LangChain Support☆14Apr 18, 2023Updated 3 years ago
- KopikatAPI is Python library for interacting with the Kopikat API.☆17Updated this week
- Working recipe: MiniMax-M3 NVFP4 at tensor-parallel 3 across 3x DGX Spark (GB10/sm_121) with clean tool-calling. Includes the head-node O…☆16Jul 13, 2026Updated 4 months ago
- Docker container for use with Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch☆10Jan 19, 2019Updated 7 years ago
- Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and in…☆18Nov 11, 2024Updated 2 years ago
- ☆23Oct 19, 2024Updated 2 years ago
- [NeurIPS-26] An open-source platform for long-horizon UAV vision-language navigation over satellite maps☆23Sep 28, 2026Updated last month
Are these results useful?