spirobel / bunny-llama
iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh
☆48Updated last year
Alternatives and similar repositories for bunny-llama:
Users that are interested in bunny-llama are comparing it to the libraries listed below
- Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp☆43Updated 8 months ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆66Updated last year
- A library for incremental loading of large PyTorch checkpoints☆56Updated last year
- Local Startup Advisor Chatbot☆30Updated last year
- Web browser version of StarCoder.cpp☆43Updated last year
- A clone of OpenAI's Tokenizer page for HuggingFace Models☆44Updated last year
- A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.☆44Updated 5 months ago
- Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU☆102Updated last year
- asynchronous/distributed speculative evaluation for llama3☆37Updated 5 months ago
- ☆53Updated 4 months ago
- Converts JSON-Schema to GBNF grammar to use with llama.cpp☆51Updated last year
- Visual inference exploration & experimentation playground☆84Updated last month
- VSCode extension for LLM-assisted code/text completion☆24Updated last week
- GGML implementation of BERT model with Python bindings and quantization.☆52Updated 10 months ago
- LLama implementations benchmarking framework☆12Updated last year
- ☆31Updated last year
- ☆21Updated 7 months ago
- Light WebUI for lm.rs☆22Updated 3 months ago
- Port of Microsoft's BioGPT in C/C++ using ggml☆88Updated 10 months ago
- GRDN.AI app for garden optimization☆70Updated 11 months ago
- Run Python functions on desktop, mobile, web, and in the cloud. https://fxn.ai/explore☆39Updated last month
- Evolutionary Search for expert-level performance on any task with environmental feedback☆14Updated 11 months ago
- Embedding models from Jina AI☆57Updated last year
- ☆34Updated last year
- Proof of concept for a generative AI application framework powered by WebAssembly and Extism☆14Updated last year
- ☆27Updated 3 weeks ago
- emoji_finder☆15Updated 3 weeks ago
- Image Generation API Server - Similar to https://text-generator.io but for images☆49Updated last month
- Access fireworks.ai models via API☆11Updated 8 months ago