dwarvesf / llm-hosting
This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Large Language Models with an OpenAI compatible vLLM server.
☆22Updated last month
Alternatives and similar repositories for llm-hosting:
Users that are interested in llm-hosting are comparing it to the libraries listed below
- The official Python library for Formulaic☆16Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 5 months ago
- Chrome Extension for exploring Hugging Face datasets 🔎☆49Updated 7 months ago
- Paste Word, get Markdown☆16Updated 8 months ago
- Create embeddings for LLM using the Nomic API☆23Updated 5 months ago
- AgentFence is an open-source platform for automatically testing AI agent security. It identifies vulnerabilities such as prompt injection…☆11Updated last month
- A swarm of LLM agents that will help you test, document, and productionize your code!☆15Updated last week
- A collection of tools for your LLMs that run on Modal☆18Updated last month
- convert natural language into technical diagrams☆14Updated 4 months ago
- GraphRag vs Embeddings☆13Updated 9 months ago
- FalkorDB-Browser is a visualization UI for FalkorDB.☆30Updated this week
- Contains the model patches and the eval logs from the passing swe-bench-lite run.☆10Updated 9 months ago
- Tools for formatting large language model prompts.☆12Updated last year
- Using modal.com to process FineWeb-edu data☆20Updated 3 weeks ago
- Web Interface for Vision Language Models Including InternVLM2☆21Updated 8 months ago
- A text-to-SQL prototype on the northwind sqlite dataset☆12Updated 7 months ago
- Structured outputs from DSPy and Jinja2☆23Updated 4 months ago
- LLM code editor for backend services☆14Updated 6 months ago
- MCP remote server for AI Engineer World's Fair 2025☆12Updated last week
- Python client for txtai☆14Updated this week
- A collection of tools that can be used for LLM function calling☆33Updated last year
- An advanced distributed knowledge fabric for intelligent document processing, featuring multi-document agents, optimized query handling, …☆27Updated 8 months ago
- Diff filtering, text mapping, and windowed transforms for LLM apps☆14Updated 2 weeks ago
- LangChain + LiteLLM that works☆39Updated last week
- Python package for extractive NLP using the OpenAI API☆17Updated 7 months ago
- A cog model for the all-mpnet-base-v2 sentence-transformers embedding model.☆11Updated last year
- LLM plugin for models hosted by Anyscale Endpoints☆33Updated last year
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆34Updated last year
- a simple create-llama template using llama-index v0.10 and integrated with Ollama☆10Updated 11 months ago
- ☆27Updated 3 weeks ago