di37 / LLM-Load-Unload-Ollama
This is a simple demonstration to show how to keep an LLM loaded for prolonged time in the memory or unloading the model immediately after inferencing when using it via Ollama.
☆13Updated last year
Alternatives and similar repositories for LLM-Load-Unload-Ollama
Users that are interested in LLM-Load-Unload-Ollama are comparing it to the libraries listed below
Sorting:
- Flan-t5-base model was fine-tuned on Nvidia Question and Answer Pair Dataset available on Kaggle. This is a beginner level project who wa…☆22Updated last year
- It includes the concepts for RAG application from basics till advanced using LangChain library.☆16Updated last year
- Question Answering System API based on all of the Harry Potter Books that will allow to answer all the events that took please in the Har…☆13Updated 2 years ago
- Chatbot implementation using ChatGPT API and Gradio.☆13Updated 2 years ago
- ☆13Updated 11 months ago
- AI-powered YouTube Notes Generator: Create detailed notes from YouTube videos. Streamlit UI for easy use.☆43Updated 9 months ago
- This projects aims to show how whisper model can be fine-tuned on language it was not trained but is trained on similar language to it.☆11Updated last year
- This project demonstrates how to utilize Codellama, a local open-source Large Language Model (LLM), and customize its behavior according …☆34Updated last year
- A Simple Scenes Based Movie Generation App☆51Updated 6 months ago
- Record voice notes & transcribe, summarize, and get tasks☆42Updated last year
- Fine-tuning Llama-3-8B on the MathInstruct dataset☆33Updated 9 months ago
- WhisperAnywhere: Effortless speech-to-text everywhere on your Mac. Use a hotkey to dictate in any app, powered by Whisper AI and Groq API…☆29Updated 8 months ago
- GPT-4o-Realtime based AI Podcast Generator☆32Updated 6 months ago
- This repository contains a project that focuses on evaluating the performance of different Language Models (LLMs) for multi-class news cl…☆17Updated 11 months ago
- ☆29Updated 11 months ago
- jemma & her ai agents that build software☆95Updated 11 months ago
- ☆21Updated 2 months ago
- Create chatbot and AI agent workflows with unified access.☆49Updated this week
- LLM fragment plugin to turn a video into images of different frames☆27Updated last week
- A Newsletter Agent that Aggregates Articles and Generates a Newsletter - Langflow, NextJS☆54Updated 5 months ago
- Sample web apps built with xRx-Core☆163Updated 3 months ago
- https://narrateit.streamlit.app/☆36Updated 4 months ago
- Access your Ollama inference server running on your computer from anywhere. Set up with NextJS + Langchain JS LCEL + Ngrok☆25Updated last year
- CrewAI agents that gather and analyze YouTube comments to generate insights to inform better content creation.☆60Updated 11 months ago
- Simple Chainlit UI for running llms locally using Ollama and LangChain☆116Updated 9 months ago
- Chrome extension that interacts with content using Groq☆41Updated 4 months ago
- napkins.dev – from screenshot to app☆86Updated 7 months ago
- VSCode Copilot for Groq fans!☆41Updated 9 months ago
- ☆13Updated 4 months ago
- ☆59Updated last year