richardanaya / gbnfLinks
A library for working with GBNF files
☆27Updated 2 months ago
Alternatives and similar repositories for gbnf
Users that are interested in gbnf are comparing it to the libraries listed below
Sorting:
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated last year
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆65Updated 2 years ago
- Using langchain, deeplake and openai to create a Q&A on the Mojo lang programming manual☆22Updated 2 years ago
- ☆32Updated 2 years ago
- Run AI models anywhere. https://muna.ai/explore☆75Updated last week
- Converts JSON-Schema to GBNF grammar to use with llama.cpp☆55Updated 2 years ago
- Light WebUI for lm.rs☆24Updated last year
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆76Updated 2 years ago
- A high performance batching router optimises max throughput for text inference workload☆16Updated 2 years ago
- A web-app to explore topics using LLM (less typing and more clicks)☆67Updated 2 years ago
- A guidance compatibility layer for llama-cpp-python☆36Updated 2 years ago
- ☆10Updated 2 years ago
- A modular framework for building massively parallel agentic systems☆29Updated 4 months ago
- Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp☆45Updated last year
- LLM plugin for clustering embeddings☆82Updated last year
- Easily create LLM automation/agent workflows☆60Updated last year
- Using modal.com to process FineWeb-edu data☆20Updated 9 months ago
- Plug n Play GBNF Compiler for llama.cpp☆28Updated 2 years ago
- ☆50Updated last year
- George is an API leveraging AI to make it easy to control a computer with natural language.☆50Updated last year
- A cli app for experimenting with kokoro voice creating and mixing using the available voices to interpolate new ones☆36Updated 11 months ago
- fast state-of-the-art speech models and a runtime that runs anywhere 💥☆57Updated 7 months ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Updated last year
- 33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU☆13Updated last year
- Jupyter notebooks for cloud-based usage☆10Updated 2 years ago
- Extract structured data from local or remote LLM models☆54Updated last year
- A daemon that makes a desktop OS accessible to AI agents☆38Updated 7 months ago
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆47Updated last year
- utilities for loading and running text embeddings with onnx☆45Updated 5 months ago