Run fast LLM Inference using Llama.cpp in Python
☆19Jan 3, 2024Updated 2 years ago
Alternatives and similar repositories for llama-cpp-python-bindings
Users that are interested in llama-cpp-python-bindings are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🧠 Workshop Notebook and assets for the Anthropic Hackathon☆12Nov 4, 2023Updated 2 years ago
- generate & query embeddings from VTT files using openai & pinecone on Andrej Karpathy's's latest GPT tutorial☆19Oct 9, 2023Updated 2 years ago
- Test-Time Memory Framework: Control Hallucinations in Foundation Models☆11Nov 4, 2025Updated 5 months ago
- Dataset and Codes for our EMNLP 2022 Main Conference Long Paper titled "ECTSum: A New Benchmark Dataset For Bullet Point Summarization of…☆32May 22, 2024Updated last year
- ☆11Apr 25, 2021Updated 4 years ago
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- Your Python AI Coder!☆36May 21, 2025Updated 10 months ago
- A web application built using gradio for classification of flower images☆10Apr 21, 2021Updated 4 years ago
- This is "Your Private StackOverflow" app that helps you perform generative search in your code bases. This is built using open-source sta…☆11Aug 14, 2023Updated 2 years ago
- Tutorials on how to Query Data☆13Jan 7, 2023Updated 3 years ago
- FlaskRestful + Swagger UI + Docker Compose + Unit Test | How to organize Python Code for REST API☆14Jun 5, 2022Updated 3 years ago
- ☆12Oct 25, 2023Updated 2 years ago
- Perplexity Lite using Langgraph, Tavily, and GPT-4.☆14Jan 11, 2024Updated 2 years ago
- Use LLMs to clean your gmail inbox☆21Dec 23, 2023Updated 2 years ago
- All the solutions for the Sliding window Algorithms☆12May 5, 2022Updated 3 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This is a QA bot based on Code Llama. It is a new LLM for code by Meta AI.☆13Aug 25, 2023Updated 2 years ago
- Code for the paper "Measuring Bias in Contextualized Word Representations"☆35Jul 19, 2019Updated 6 years ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆16Mar 30, 2026Updated last week
- The code for the tutorial of the GrahpEdit and GraphNode nodes.☆16Mar 10, 2019Updated 7 years ago
- Detecting unsaved changes in a Mac Catalyst window and preventing closure or app termination☆22Feb 8, 2023Updated 3 years ago
- ☆13May 5, 2016Updated 9 years ago
- An MCP server implementation providing a standardized interface for LLMs to interact with the Atla API.☆17Jul 21, 2025Updated 8 months ago
- Examples in the MLX framework☆11Sep 23, 2024Updated last year
- In today's data-driven landscape, the exponential growth of unstructured data has ushered in a new era of opportunities and challenges. "…☆12Sep 17, 2023Updated 2 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ComfyUI-Direct3D‑S2 is now available in ComfyUI, Direct3D‑S2 - Gigascale 3D Generation Made Easy with Spatial Sparse Attention. Direct3D‑…☆17Jun 10, 2025Updated 10 months ago
- Tune MPTs☆84Jun 17, 2023Updated 2 years ago
- This repository holds files and scripts for incorporating simple CI/CD practices for model training in ML.☆21Oct 26, 2021Updated 4 years ago
- Next.js Boilerplate with mongoose (MongoDB), Prettier, JSend and SEO☆11Jan 21, 2023Updated 3 years ago
- ☆10Nov 17, 2024Updated last year
- resources, links for OCR & greek☆10Mar 8, 2021Updated 5 years ago
- Flexible and transparent Python Boruta implementation☆15Jun 8, 2025Updated 10 months ago
- ☆23Jul 10, 2023Updated 2 years ago
- Associated code for the Quickstart tutorial☆17Aug 18, 2023Updated 2 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Port of Facebook's LLaMA model in C/C++☆17May 17, 2023Updated 2 years ago
- Mixture of Expert (MoE) techniques for enhancing LLM performance through expert-driven prompt mapping and adapter combinations.☆12Feb 11, 2024Updated 2 years ago
- Code samples from my blog, https://poanchen.github.io/blog/☆12Oct 28, 2020Updated 5 years ago
- Huggingface Backup - Jupyter, Colab and Python Script☆10Jan 20, 2026Updated 2 months ago
- Facemask detection using MobileNet☆15Jun 18, 2022Updated 3 years ago
- Gradio chat interface for FastMLX☆12Sep 22, 2024Updated last year
- ☆26Updated this week