karelnagel / llama-app
Run LLaMA inference on CPU, with Rust 🦀🚀🦙
☆22Updated last year
Alternatives and similar repositories for llama-app:
Users that are interested in llama-app are comparing it to the libraries listed below
- A desktop transcription software☆13Updated this week
- Friendly interface to chat with an Ollama instance.☆51Updated last month
- Acoustic echo cancellation in Rust with speexdsp☆17Updated last month
- bott: Your Terminal Copilot☆84Updated last year
- Light WebUI for lm.rs☆23Updated 3 months ago
- 8-bit floating point types for Rust☆41Updated this week
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆56Updated last year
- The fastest CLI tool for prompting LLMs. Including support for prompting several LLMs at once!☆68Updated 3 weeks ago
- Bleeding edge low level Rust binding for GGML☆16Updated 7 months ago
- Ask shortgpt for instant and concise answers☆13Updated last year
- AI Assistant☆18Updated last week
- Generative AI web UI and server☆21Updated last year
- A set of Rust macros for working with OpenAI function/tool calls.☆43Updated 10 months ago
- This is a Rust library that provides a CLI (command-line interface) for easy and convenient access to the OpenAI ChatGPT API. The library…☆10Updated last year
- A CLI in Rust to generate synthetic data for MLX friendly training☆18Updated last year
- A Rust open source cross-platform ChatGPT/Gemini UI (Linux / Win / MacOS).☆22Updated 11 months ago
- An openAI CLI built in rust☆10Updated 2 years ago
- Google Chrome for Cloud Services☆14Updated this week
- 33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU☆13Updated 8 months ago
- A simple and clear way of hosting llama.cpp as a private HTTP API using Rust☆26Updated 7 months ago
- Run LLaMA inference on CPU, with Rust 🦀🚀🦙☆18Updated 3 weeks ago
- Cross-platform screen recorder, transcript, subtitle. Built with Tauri & Whisper-rs (rust port of whisper.cpp)☆24Updated 5 months ago
- gRPC web crawler turbo charged for performance☆52Updated 5 months ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆41Updated 3 months ago
- Rust Vector for large amounts of data, that does not copy when growing, by using full `mmap`'d pages.☆22Updated 10 months ago
- A simple 2D snake game built with Bevy and WASM☆10Updated 2 years ago
- Rust bindings to https://github.com/leejet/stable-diffusion.cpp☆12Updated this week
- auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…☆35Updated 2 months ago
- Coverts simple basic shell scripts to windows batch scripts.☆58Updated 6 months ago
- Command line tool for converting images to ASCII art☆17Updated 3 months ago