nova-land / gbnf-compilerLinks
Plug n Play GBNF Compiler for llama.cpp
☆28Updated 2 years ago
Alternatives and similar repositories for gbnf-compiler
Users that are interested in gbnf-compiler are comparing it to the libraries listed below
Sorting:
- A guidance compatibility layer for llama-cpp-python☆36Updated 2 years ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆47Updated last year
- ☆32Updated 2 years ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆76Updated 2 years ago
- Generates grammer files from typescript for LLM generation☆38Updated last year
- Experimental sampler to make LLMs more creative☆31Updated 2 years ago
- GPT-2 small trained on phi-like data☆68Updated last year
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆43Updated last year
- Simple Graph Memory for AI applications☆90Updated 8 months ago
- The one who calls upon functions - Function-Calling Language Model☆36Updated 2 years ago
- Embedding models from Jina AI☆65Updated 2 years ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆90Updated 4 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆100Updated 6 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆90Updated last month
- ☆68Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆69Updated 2 months ago
- Experimental LLM Inference UX to aid in creative writing☆127Updated last year
- Code action agent with local execution sandbox and first-class support for programmatic tool calling☆119Updated last week
- Let's create synthetic textbooks together :)☆75Updated 2 years ago
- ☆38Updated last year
- large language model for mastering data analysis using pandas☆48Updated 2 years ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆52Updated last year
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- Chat Markup Language conversation library☆55Updated 2 years ago
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago
- LLM plugin for clustering embeddings☆82Updated last year
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year
- Client-side toolkit for using large language models, including where self-hosted☆114Updated last month
- Train an adapter for any embedding model in under a minute☆130Updated 9 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆83Updated last year