kennethleungty / Llama-2-Open-Source-LLM-CPU-Inference
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
☆959Updated last year
Alternatives and similar repositories for Llama-2-Open-Source-LLM-CPU-Inference:
Users that are interested in Llama-2-Open-Source-LLM-CPU-Inference are comparing it to the libraries listed below
- ☆1,463Updated last year
- 🤖 Deploy a private ChatGPT alternative hosted within your VPC. 🔮 Connect it to your organization's knowledge base and use it as a corpo…☆1,493Updated last year
- Evaluation tool for LLM QA chains☆1,073Updated last year
- Run inference on MPT-30B using CPU☆575Updated last year
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,857Updated last year
- Open-source tool to visualise your RAG 🔮☆1,120Updated 3 months ago
- ☆764Updated last year
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,263Updated 3 weeks ago
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,474Updated last year
- LLM as a Chatbot Service☆3,312Updated last year
- ☆1,025Updated last year
- ☆1,468Updated last year
- Simple UI for LLM Model Finetuning☆2,063Updated last year
- Agent techniques to augment your LLM and push it beyong its limits☆1,571Updated 10 months ago
- ⚡ Langchain apps in production using Jina & FastAPI☆1,626Updated last year
- Ship RAG based LLM web apps in seconds.☆988Updated last year
- Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend…☆1,957Updated last year
- Visualization and debugging tool for LangChain workflows☆730Updated last year
- Allows to scale the ChatGPT API to multiple simultaneous sessions with infinite contextual and adaptive memory powered by GPT and Redis d…☆526Updated last year
- A comprehensive guide to building RAG-based LLM applications for production.☆1,787Updated 8 months ago
- kani (カニ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)☆572Updated this week
- One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) 🌈🐂 Replace OpenAI GPT…☆753Updated last year
- Fine-Tuning Embedding for RAG with Synthetic Data☆490Updated last year
- A voice chat app☆1,113Updated 4 months ago
- Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-sour…☆2,640Updated 6 months ago
- Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"☆2,333Updated 3 months ago
- An Open-source Toolkit for LLM Development☆2,767Updated 2 months ago
- Learn to build and deploy AI apps.☆345Updated last year
- A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer☆1,631Updated last year
- Salesforce open-source LLMs with 8k sequence length.☆716Updated 2 months ago