nicholasyager / llama-cpp-guidanceLinks
A guidance compatibility layer for llama-cpp-python
☆36Updated 2 years ago
Alternatives and similar repositories for llama-cpp-guidance
Users that are interested in llama-cpp-guidance are comparing it to the libraries listed below
Sorting:
- The one who calls upon functions - Function-Calling Language Model☆36Updated 2 years ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated last year
- ☆67Updated last year
- Plug n Play GBNF Compiler for llama.cpp☆28Updated 2 years ago
- ☆117Updated 11 months ago
- run ollama & gguf easily with a single command☆52Updated last year
- A simple experiment on letting two local LLM have a conversation about anything!☆112Updated last year
- Easily view and modify JSON datasets for large language models☆84Updated 6 months ago
- GPT-2 small trained on phi-like data☆67Updated last year
- Easily create LLM automation/agent workflows☆60Updated last year
- A high performance batching router optimises max throughput for text inference workload☆16Updated 2 years ago
- ☆164Updated 3 months ago
- ☆38Updated last year
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- A fast batching API to serve LLM models☆189Updated last year
- Client-side toolkit for using large language models, including where self-hosted☆113Updated last week
- Complex RAG backend☆29Updated last year
- ☆32Updated last year
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆76Updated 2 years ago
- Let's create synthetic textbooks together :)☆75Updated last year
- ☆74Updated 2 years ago
- Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.☆79Updated 2 years ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆91Updated 2 months ago
- large language model for mastering data analysis using pandas☆48Updated 2 years ago
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆103Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year
- An OpenAI-like LLaMA inference API☆113Updated 2 years ago
- ☆134Updated 7 months ago
- PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.☆116Updated 2 years ago
- An OpenAI Completions API compatible server for NLP transformers models☆65Updated 2 years ago