dwarvesf / llm-hosting
This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Large Language Models with an OpenAI compatible vLLM server.
☆23Updated 2 months ago
Alternatives and similar repositories for llm-hosting
Users that are interested in llm-hosting are comparing it to the libraries listed below
Sorting:
- Chrome Extension for exploring Hugging Face datasets 🔎☆50Updated 7 months ago
- The official Python library for Formulaic☆16Updated last year
- A text-to-SQL prototype on the northwind sqlite dataset☆12Updated 7 months ago
- Tools for formatting large language model prompts.☆13Updated last year
- GraphRag vs Embeddings☆13Updated 10 months ago
- FalkorDB-Browser is a visualization UI for FalkorDB.☆30Updated this week
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆34Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 6 months ago
- A collection of tools for your LLMs that run on Modal☆18Updated 2 months ago
- Structured outputs from DSPy and Jinja2☆23Updated 4 months ago
- 🛤️ Pathik - High-Performance Web Crawler ⚡☆26Updated last month
- AgentFence is an open-source platform for automatically testing AI agent security. It identifies vulnerabilities such as prompt injection…☆11Updated 2 months ago
- ☆12Updated 2 years ago
- Python package for extractive NLP using the OpenAI API☆17Updated 8 months ago
- Using modal.com to process FineWeb-edu data☆20Updated last month
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆33Updated last month
- Use sync mode Playwright interactively, inside a Jupyter notebook☆14Updated last month
- ☆32Updated last year
- ☆20Updated last year
- ☆13Updated 8 months ago
- convert natural language into technical diagrams☆14Updated 5 months ago
- ☆32Updated last year
- LLM plugin for embeddings using sentence-transformers☆60Updated 3 weeks ago
- ☆19Updated 7 months ago
- ☆41Updated 5 months ago
- ☆20Updated last year
- Create embeddings for LLM using the Nomic API☆23Updated 5 months ago
- Handout for a talk I gave about LLM and CLI tools☆63Updated 11 months ago
- Lightweight OpenAI wrapper using FastAPI. Add rate limits to OpenAI usage, optionally log and store all API calls, and share regulated Op…☆13Updated last year
- applications of https://github.com/PrefectHQ/marvin☆12Updated last year