autonomi-ai / nosLinks
⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.
☆145Updated last year
Alternatives and similar repositories for nos
Users that are interested in nos are comparing it to the libraries listed below
Sorting:
- ☆197Updated last year
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆139Updated last year
- Vector Database with support for late interaction and token level embeddings.☆55Updated 5 months ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- GRDN.AI app for garden optimization☆70Updated last year
- LLaVA server (llama.cpp).☆183Updated 2 years ago
- ☆38Updated last year
- run paligemma in real time☆133Updated last year
- ScalarLM - a unified training and inference stack☆93Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆53Updated last year
- Foyle is a copilot to help developers deploy and operate their applications.☆133Updated 8 months ago
- LLM family chart☆52Updated 2 years ago
- ☆113Updated last year
- A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.☆163Updated 3 weeks ago
- Full finetuning of large language models without large memory requirements☆93Updated last month
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆53Updated 2 months ago
- Efficient vector database for hundred millions of embeddings.☆208Updated last year
- GPU prices aggregator for cloud providers☆44Updated this week
- Chat Markup Language conversation library☆55Updated last year
- experiments with inference on llama☆103Updated last year
- Python client library for improving your LLM app accuracy☆97Updated 9 months ago
- Maybe the new state of the art vision model? we'll see 🤷♂️☆165Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆146Updated 2 years ago
- ☆89Updated last year
- ☆64Updated 7 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Synthetic Data for LLM Fine-Tuning☆119Updated last year
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- ☆67Updated last year
- Let's create synthetic textbooks together :)☆75Updated last year