dwarvesf / llm-hostingLinks
This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Large Language Models with an OpenAI compatible vLLM server.
β26Updated 9 months ago
Alternatives and similar repositories for llm-hosting
Users that are interested in llm-hosting are comparing it to the libraries listed below
Sorting:
- Chrome Extension for exploring Hugging Face datasets πβ49Updated last year
- Embedding models from Jina AIβ65Updated last year
- Hybrid Search (BM25 & Vector) with SQLiteβ26Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minβ¦β26Updated last year
- The official Python library for Formulaicβ18Updated last year
- Contains the model patches and the eval logs from the passing swe-bench-lite run.β10Updated last year
- A framework for building large-scale, deterministic, interactive workflows with a fault-tolerant, conversational UXβ43Updated last week
- LLM plugin for clustering embeddingsβ82Updated last year
- An introduction to DSPyβ32Updated 4 months ago
- Voyage AI Official Python Libraryβ85Updated 2 weeks ago
- Demo of knowledge graph creation and Graph RAG with BAML and Kuzuβ73Updated 3 months ago
- Chat Markup Language conversation libraryβ55Updated last year
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graphβ25Updated last year
- Repo to experiment with Graph RAG strategies using KΓΉzuβ63Updated 3 months ago
- β17Updated 5 months ago
- Verbosity control for AI agentsβ64Updated last year
- Tools for formatting large language model prompts.β13Updated 2 years ago
- examples and guides to using Nomic Atlasβ37Updated 8 months ago
- Vanilla-Python ergonomics on top of DSPyβ39Updated 6 months ago
- scraping and querying documents for LLMsβ24Updated 2 months ago
- β32Updated last month
- PyLate efficient inference engineβ68Updated 3 months ago
- β21Updated last year
- Public reports detailing responses to sets of prompts by Large Language Models.β32Updated 11 months ago
- LLM plugin for models hosted by Anyscale Endpointsβ35Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing β‘β68Updated last month
- Run embedding models using ONNXβ35Updated last year
- Using modal.com to process FineWeb-edu dataβ20Updated 8 months ago
- LLM plugin for embeddings using sentence-transformersβ73Updated 8 months ago
- A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.β89Updated last year