awinml / llama-cpp-python-bindingsLinks
Run fast LLM Inference using Llama.cpp in Python
☆19Updated last year
Alternatives and similar repositories for llama-cpp-python-bindings
Users that are interested in llama-cpp-python-bindings are comparing it to the libraries listed below
Sorting:
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆27Updated last year
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆37Updated last year
- ☆55Updated 2 months ago
- Tutorial for DSPy☆25Updated last year
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆102Updated last year
- Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.☆48Updated last year
- Embed anything.☆27Updated last year
- ☆10Updated 11 months ago
- ☆29Updated 2 years ago
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆37Updated 2 years ago
- Local first human friendly agents toolkit for the browser and Nodejs☆44Updated last week
- Dynamic Metadata based RAG Framework☆76Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year
- The Arcee client for executing domain-adpated language model routines https://pypi.org/project/arcee-py/☆27Updated last year
- Your Python AI Coder!☆35Updated 5 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆111Updated 6 months ago
- YouTube Video Summarization App built using open source LLM and Framework like Llama 2, Haystack, Whisper, and Streamlit. This app smooth…☆56Updated last year
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- ☆28Updated last year
- Simple Chainlit UI for running llms locally using Ollama and LangChain☆46Updated last year
- run ollama & gguf easily with a single command☆52Updated last year
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆130Updated last year
- ☆43Updated last year
- Democratizing Function Calling Capabilities for Open-Source Language Models☆41Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hours☆65Updated last year
- Python Server for C3 AI app. A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) with…☆24Updated last year
- Simple Chat UI using Falcon model, LangChain and Chainlit☆59Updated 2 years ago
- RAGArch is a Streamlit-based application that empowers users to experiment with various components and parameters of Retrieval-Augmented …☆88Updated last year
- Own your AI, search the web with it🌐😎☆92Updated 9 months ago
- ☆45Updated last year