dwarvesf / llm-hosting
This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Large Language Models with an OpenAI compatible vLLM server.
β20Updated 2 weeks ago
Alternatives and similar repositories for llm-hosting:
Users that are interested in llm-hosting are comparing it to the libraries listed below
- Chrome Extension for exploring Hugging Face datasets πβ49Updated 6 months ago
- The official Python library for Formulaicβ16Updated 10 months ago
- Paste Word, get Markdownβ15Updated 7 months ago
- Python package for extractive NLP using the OpenAI APIβ17Updated 6 months ago
- β26Updated this week
- Structured outputs from DSPy and Jinja2β23Updated 2 months ago
- Using modal.com to process FineWeb-edu dataβ20Updated 2 weeks ago
- Create embeddings for LLM using the Nomic APIβ23Updated 4 months ago
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.β33Updated last year
- Don't bug your friends with articles they'll never read. AI's have infinite attention, leverage them instead! Use the curation buddy to eβ¦β22Updated 10 months ago
- β30Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minβ¦β25Updated 4 months ago
- Python client for txtaiβ12Updated last week
- Tools for formatting large language model prompts.β12Updated last year
- LLM code editor for backend servicesβ14Updated 5 months ago
- β20Updated last year
- examples and guides to using Nomic Atlasβ27Updated last month
- GraphRag vs Embeddingsβ13Updated 8 months ago
- A swarm of LLM agents that will help you test, document, and productionize your code!β14Updated this week
- Contains the model patches and the eval logs from the passing swe-bench-lite run.β10Updated 8 months ago
- β18Updated 5 months ago
- applications of https://github.com/PrefectHQ/marvinβ12Updated last year
- π§ Mem4AI: A LLM Friendly memory management library.β20Updated 4 months ago
- watch your screen while doing sales and fill your crm automaticallyβ15Updated 9 months ago
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1β¦β14Updated last year
- Web Interface for Vision Language Models Including InternVLM2β19Updated 7 months ago