nova-land / gbnf-compilerLinks
Plug n Play GBNF Compiler for llama.cpp
☆25Updated last year
Alternatives and similar repositories for gbnf-compiler
Users that are interested in gbnf-compiler are comparing it to the libraries listed below
Sorting:
- A guidance compatibility layer for llama-cpp-python☆35Updated last year
- ☆31Updated last year
- Experimental sampler to make LLMs more creative☆31Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 7 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 7 months ago
- Python console application designed to provide an engaging and visually appealing LLM chat experience on Unix-like consoles or Terminals.☆24Updated this week
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- ☆73Updated last year
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆35Updated last year
- Very minimal (and stateless) agent framework☆44Updated 5 months ago
- LMQL implementation of tree of thoughts☆34Updated last year
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆75Updated last year
- ☆66Updated last year
- Chat Markup Language conversation library☆55Updated last year
- Python examples using the bigcode/tiny_starcoder_py 159M model to generate code☆44Updated 2 years ago
- Generates grammer files from typescript for LLM generation☆38Updated last year
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated 8 months ago
- GPT-2 small trained on phi-like data☆66Updated last year
- ☆22Updated last year
- 5X faster 60% less memory QLoRA finetuning☆21Updated last year
- A Python library to orchestrate LLMs in a neural network-inspired structure☆49Updated 8 months ago
- One Line To Build Zero-Data Classifiers in Minutes☆56Updated 8 months ago
- Simple Graph Memory for AI applications☆86Updated last month
- large language model for mastering data analysis using pandas☆47Updated last year
- ☆49Updated last year
- Generate Structured JSON with probs from Language Models☆17Updated 3 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆61Updated 11 months ago
- Tool to apply Legal Matter Specification Standard (LMSS) to documents☆13Updated 10 months ago
- ☆30Updated 11 months ago
- Using Large Language Models for Repo-wide Type Prediction☆109Updated last year