This Open LLM Framework serves as a powerful and flexible tool for serving endpoints for embeddings and chat completions using SOTA open source language models. By leveraging models Transformers, this enables various natural language processing (NLP) tasks to be performed via simple HTTP endpoints similar to openai endpoints.
☆21Sep 4, 2024Updated last year
Alternatives and similar repositories for open-llm-server
Users that are interested in open-llm-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Local models support for Microsoft's graphrag using ollama (llama3, mistral, gemma2 phi3)- LLM & Embedding extraction☆1,103May 8, 2026Updated last month
- This repo is my settings for using the local LLM with graphrag & an UI to chat with the index result☆16Jul 24, 2024Updated last year
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆20Sep 5, 2024Updated last year
- Raycast extension for usememos/memos.☆11Mar 8, 2025Updated last year
- Useful snippets for your chrome/firefox browsers☆16Apr 10, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A template to create your own literature survey engine☆14Updated this week
- 修改 pyTranscriber 得到 cli 版的 mypyTranscriber☆11Jun 9, 2021Updated 5 years ago
- A command line interface for augmented Alfred workflows.☆16Updated this week
- Ensure that your Johnny Decimal system is neat and clean.☆18Updated this week
- A simple demo of Omnivore's API☆15Jan 9, 2024Updated 2 years ago
- This is where I keep my applescript's and BetterTouchTool configuration, and some apps/automation's I use.☆15Aug 30, 2025Updated 10 months ago
- Apple Script commands for Browser Deputy.☆18Aug 25, 2023Updated 2 years ago
- Looks up command line syntax from cheatsheets using fuzzy search☆16May 27, 2026Updated last month
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆38May 14, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A collection of my personal Mac setup files☆13May 31, 2023Updated 3 years ago
- open-source mac menu bar app that allows you to clip python scripts☆15Oct 17, 2024Updated last year
- Tag macOS Finder items via keyboard shortcut☆20Oct 14, 2017Updated 8 years ago
- A collection of Keyboard Maestro text expansion macros☆12Aug 6, 2025Updated 10 months ago
- Knowtate is a sophisticated platform designed to elevate your academic research experience. Seamlessly blend reading, note-taking with ma…☆12Sep 19, 2024Updated last year
- A bookmark manager that interacts with the raindrop.io API, built with the Python Textual TUI framework.☆15May 31, 2026Updated last month
- Dry::CLI Command to generate a completion script for bash/zsh☆12Apr 27, 2026Updated 2 months ago
- ☆12Feb 22, 2021Updated 5 years ago
- The Stupid Tagger for DEVONthink Pro☆14Oct 10, 2017Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Generate disposable email inboxes☆15Oct 31, 2025Updated 8 months ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆19Jun 22, 2026Updated last week
- The MessageBroker is a typescript library for providing asynchronous communication throughout your app☆21Updated this week
- Direct port of the Bullet physics engine to JavaScript using Emscripten☆12Apr 1, 2025Updated last year
- Automatically collect and summarize articles from WeChat Official Accounts, using LLM and Feishu doc.☆15Oct 15, 2024Updated last year
- ☆16Jan 28, 2020Updated 6 years ago
- Alfred workflow that shows inline search results, without a keyword.☆17Nov 24, 2025Updated 7 months ago
- Streamline is a stream-of-consciousness writer for Obsidian☆16Nov 14, 2024Updated last year
- Your Alfred friendly framework, for developing Alfred workflows in TypeScript/JavaScript 🥷☆14Apr 24, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Setup an MCP server in 60 seconds.☆13Dec 12, 2024Updated last year
- Obsidian plugin that allows to display contents of Arc sidebar right besides your notes☆14Jan 26, 2024Updated 2 years ago
- EBrowser: minimal suckless keyboard-friendly web browser based on chromium☆11May 31, 2026Updated last month
- open-deepsearch☆11Mar 3, 2025Updated last year
- Examples, tutorials, and how-to guides☆10Apr 24, 2026Updated 2 months ago
- Marksman support for Zed☆13May 3, 2026Updated 2 months ago
- A search engine built on the Unpaywall database☆20Mar 13, 2024Updated 2 years ago