dwarvesf / llm-hostingLinks
This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Large Language Models with an OpenAI compatible vLLM server.
β23Updated 5 months ago
Alternatives and similar repositories for llm-hosting
Users that are interested in llm-hosting are comparing it to the libraries listed below
Sorting:
- Chrome Extension for exploring Hugging Face datasets πβ50Updated 10 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minβ¦β26Updated 8 months ago
- Tools for formatting large language model prompts.β13Updated last year
- A collection of tools for your LLMs that run on Modalβ21Updated 5 months ago
- Contains the model patches and the eval logs from the passing swe-bench-lite run.β10Updated last year
- Using modal.com to process FineWeb-edu dataβ20Updated 4 months ago
- Embedding models from Jina AIβ62Updated last year
- β20Updated 9 months ago
- Verbosity control for AI agentsβ64Updated last year
- A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.β87Updated 8 months ago
- Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. Pydantic-AI and LiteLLM backends. Huβ¦β22Updated last week
- The official Python library for Formulaicβ16Updated last year
- Paste Word, get Markdownβ17Updated last year
- A cookiecutter template for building plugins for LLMβ28Updated 3 months ago
- Fetch message history from discord for LLMsβ15Updated last week
- Use Hermes-2-Pro-Mistral-7B function calling with your OpenAI API compatible code.β18Updated last year
- Chat Markup Language conversation libraryβ55Updated last year
- LLM plugin for clustering embeddingsβ77Updated last year
- Structured outputs from DSPy and Jinja2β26Updated last month
- A Python library to orchestrate LLMs in a neural network-inspired structureβ49Updated 10 months ago
- Handout for a talk I gave about LLM and CLI toolsβ63Updated last year
- Web Interface for Vision Language Models Including InternVLM2β22Updated last year
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.β37Updated last year
- Python package for extractive NLP using the OpenAI APIβ17Updated 11 months ago
- LLM plugin for embeddings using sentence-transformersβ70Updated 3 months ago
- Code interpreter support for o1β32Updated 10 months ago
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graphβ24Updated last year
- Apps that run on modal.comβ12Updated last month
- Run models distributed as GGUF files using LLMβ70Updated 8 months ago
- π Unstructured Data Connectors for Haystack 2.0β17Updated last year