dwarvesf / llm-hostingLinks
This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Large Language Models with an OpenAI compatible vLLM server.
☆22Updated 3 months ago
Alternatives and similar repositories for llm-hosting
Users that are interested in llm-hosting are comparing it to the libraries listed below
Sorting:
- Chrome Extension for exploring Hugging Face datasets 🔎☆50Updated 8 months ago
- Python package for extractive NLP using the OpenAI API☆17Updated 9 months ago
- A text-to-SQL prototype on the northwind sqlite dataset☆12Updated 8 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 6 months ago
- The official Python library for Formulaic☆16Updated last year
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆35Updated last year
- Contains the model patches and the eval logs from the passing swe-bench-lite run.☆10Updated 11 months ago
- Using modal.com to process FineWeb-edu data☆20Updated 2 months ago
- applications of https://github.com/PrefectHQ/marvin☆12Updated last year
- GraphRag vs Embeddings☆13Updated 10 months ago
- Create embeddings for LLM using the Nomic API☆23Updated 6 months ago
- 🛤️ Pathik - High-Performance Web Crawler ⚡☆26Updated 2 months ago
- Tools for formatting large language model prompts.☆13Updated last year
- ☆19Updated 7 months ago
- ☆20Updated last year
- convert natural language into technical diagrams☆14Updated 5 months ago
- AgentFence is an open-source platform for automatically testing AI agent security. It identifies vulnerabilities such as prompt injection…☆12Updated 2 months ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆17Updated last week
- An integration of Qdrant ANN vector database backend with txtai☆24Updated 9 months ago
- Run evals using LLM☆25Updated last year
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆33Updated last month
- Writing Blog Posts with Generative Feedback Loops!☆48Updated last year
- Benchmark study on LanceDB, an embedded vector DB, for full-text search and vector search☆26Updated last year
- Adding Marimo to Datasette☆20Updated 2 months ago
- Paste Word, get Markdown☆16Updated 10 months ago
- An AI character interaction system with emotional modeling and advanced memory management☆16Updated 7 months ago
- Detect and redact PII locally with SOTA performance☆50Updated 2 months ago
- Structured outputs from DSPy and Jinja2☆23Updated 2 weeks ago
- A function to do all☆36Updated last year
- ☆1Updated 10 months ago