shaunabanana / llama.py
A quick and dirty script to call LLaMA.cpp in Python. Supports streaming and interactive mode.
☆13Updated last year
Alternatives and similar repositories for llama.py:
Users that are interested in llama.py are comparing it to the libraries listed below
- A Qt GUI for large language models☆42Updated last year
- "Just hoof it!" - A spotlight like interface to Ollama☆61Updated 11 months ago
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆31Updated last year
- Spark is an Auto-GPT alternative that uses LocalAI.☆80Updated last year
- Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…☆212Updated last year
- python script integrating with the AI Horde via a command line interface☆59Updated 3 months ago
- Python examples using the bigcode/tiny_starcoder_py 159M model to generate code☆44Updated last year
- ☆16Updated last year
- This repository is about implementing The Personality Cores Conversation System originally developed by Aperture Science, Inc. in the Por…☆24Updated 10 months ago
- Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.☆50Updated last year
- A Voice Assistant in your Browser.☆21Updated 2 weeks ago
- LLM Chat is an open-source serverless alternative to ChatGPT.☆33Updated 6 months ago
- A QT GUI for large language models☆31Updated last year
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆36Updated last year
- Python bindings for llama.cpp☆65Updated last year
- ☆13Updated last month
- ☆22Updated last month
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆57Updated last year
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- Rivet plugin for integration with Ollama, the tool for running LLMs locally easily☆36Updated 11 months ago
- Fetch and insert AI-generated summaries of web content. Combine with Send To Kindle for quick summaries and full articles. Support for Mi…☆14Updated last month
- Jupyter notebooks for cloud-based usage☆10Updated last year
- *NIX SHELL with Local AI/LLM integration☆19Updated last month
- LLM finetuning☆42Updated last year
- ☆19Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆111Updated last year
- ToK aka Tree of Knowledge for Large Language Models LLM. It's a novel dataset that inspires knowledge symbolic correlation in simple inpu…☆51Updated last year
- Local LLM inference & management server with built-in OpenAI API☆31Updated 11 months ago
- ☆16Updated last year
- Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma☆32Updated 5 months ago