floneum / floneum
Instant, controllable, local pre-trained AI models in Rust
☆1,281Updated this week
Related projects: ⓘ
- BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentialit…☆1,881Updated last week
- A Rust library allowing to interact with the Ollama API.☆456Updated last week
- 🦜️ 🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust☆511Updated last week
- Blazingly fast LLM inference.☆3,429Updated this week
- LLM Orchestrator built in Rust☆261Updated 6 months ago
- 🦀 A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AI☆236Updated 6 months ago
- The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge☆990Updated this week
- LLama.cpp rust bindings☆320Updated 2 months ago
- 🎒 local.ai - Run AI locally on your PC!☆609Updated 11 months ago
- Rust library and CLI tool for OCR (extracting text from images)☆1,103Updated 2 weeks ago
- A fast llama2 decoder in pure Rust.☆1,005Updated 9 months ago
- [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models☆6,063Updated 2 months ago
- A simple ChatGPT clone in Rust on both the frontend and backend. Uses open source language models and TailwindCSS.☆382Updated 6 months ago
- `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tas…☆1,303Updated last month
- ⚡ Edgen: Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), …☆328Updated 3 months ago
- Deep learning at the speed of light.☆1,441Updated last month
- Multi-platform desktop app to download and run Large Language Models(LLM) locally in your computer.☆260Updated last year
- Rust bindings to https://github.com/ggerganov/whisper.cpp☆655Updated last week
- Stable Diffusion v1.4 ported to Rust's burn framework☆311Updated 6 months ago
- A cross-platform browser ML framework.☆567Updated last week
- RustGPT is a ChatGPT UI built with Rust + HTMX: the power of Rust coupled with the simplicity of HTMX 💚☆659Updated 9 months ago
- Rust+OpenCL+AVX2 implementation of LLaMA inference code☆537Updated 7 months ago
- Rust library for OpenAI☆1,111Updated last week
- A reactive runtime for building durable AI agents☆1,255Updated this week
- An implementation of the diffusers api in Rust☆522Updated 5 months ago
- OpenAI API client library for Rust (unofficial)☆291Updated last week
- Hybrid vector database with flexible SQL storage engine & multi-index support.☆343Updated this week
- Llama2 LLM ported to Rust burn☆272Updated 5 months ago
- Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.☆373Updated 6 months ago
- From anywhere you can type, query and stream the output of an LLM or any other script☆442Updated 5 months ago