aahouzi / llama2-chatbot-cpu
A LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel® Extension For PyTorch with bfloat16.
☆13Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for llama2-chatbot-cpu
- Multimodal AI App using Llava 7B and Gradio.☆37Updated 6 months ago
- GGUF Quantization of any LLM.☆31Updated 8 months ago
- RAG Tool using Haystack, Mistral, and Chainlit. All open source stack on CPU.☆23Updated last year
- Question Answer Generation App using Mistral 7B, Langchain, and FastAPI.☆63Updated last year
- On-device LLM Inference using Mediapipe LLM Inference API.☆20Updated 7 months ago
- Chat with Your Data App using Langchain, ChromaDB, Sentence Transformers, and LaMiNi LM Model. This Chatbot is completely powered by Open…☆17Updated last year
- Medical Help App using GPT-4V☆23Updated 10 months ago
- A Gradio app for chatting with PDFs☆50Updated 3 months ago
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆11Updated 7 months ago
- ☆59Updated last year
- Medical RAG QA App using Meditron 7B LLM, Qdrant Vector Database, and PubMedBERT Embedding Model.☆44Updated 11 months ago
- AI voice assistant made with Streamlit python and powered by Gemini, Mistral and PHI-3☆11Updated 2 months ago
- llmware RAG Demo App.☆16Updated 11 months ago
- ☆19Updated last year
- Playing with RAG using Ollama, Langchain, and Streamlit. This project aims to demonstrate how a recruiter or HR personnel can benefit fro…☆11Updated 10 months ago
- This is a RAG implementation using Open Source stack. BioMistral 7B has been used to build this app along with PubMedBert as an embedding…☆62Updated 9 months ago
- A library for evaluating Retrieval-Augmented Generation (RAG) systems (The traditional ways).☆24Updated 3 months ago
- Medical Mixture of Experts LLM using Mergekit.☆20Updated 8 months ago
- Search Your PDF App using Langchain, ChromaDB, Sentence Transformers, and LaMiNi LM Model. This app is completely powered by Open Source …☆56Updated 7 months ago
- Building Private Healthcare AI Assistant for Clinics Using Qdrant Hybrid Cloud, DSPy and Groq - Llama3☆21Updated 6 months ago
- A multi-agent business consultant app on streamlit implemented using crewAI☆13Updated 4 months ago
- ☆32Updated last year
- The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained mode…☆10Updated 3 months ago
- YouTube Video Summarization App built using open source LLM and Framework like Llama 2, Haystack, Whisper, and Streamlit. This app smooth…☆52Updated 6 months ago
- Using GPT-3 and Carrot (GPT-3 for computer vision) to create detailed descriptions of images.☆14Updated 2 years ago
- LLM Agent that performs sentiment analysis of drawings and natural language using a combination of Google Gemini Vision model and GPT-4 T…☆12Updated 11 months ago
- SLIM Models by LLMWare. A streamlit app showing the capabilities for AI Agents and Function Calls.☆18Updated 9 months ago
- Speak (speech-to-text) to Ollama LLMs in any lanaguage - Streamlit app☆37Updated 8 months ago
- Agentic RAG using Crew AI.☆19Updated 5 months ago
- Graphy v1: A Realtime GraphRAG App using Langchain, Neo4j, GPT-4o, and Streamlit.☆32Updated last month