dwarvesf / llm-hostingLinks
This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Large Language Models with an OpenAI compatible vLLM server.
☆26Updated 11 months ago
Alternatives and similar repositories for llm-hosting
Users that are interested in llm-hosting are comparing it to the libraries listed below
Sorting:
- Chrome Extension for exploring Hugging Face datasets 🔎☆48Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated last year
- Embedding models from Jina AI☆65Updated 2 years ago
- Voyage AI Official Python Library☆91Updated last week
- ☆20Updated last year
- Chat Markup Language conversation library☆55Updated 2 years ago
- Create embeddings for LLM using the Nomic API☆23Updated last year
- Tools for formatting large language model prompts.☆13Updated 2 years ago
- ☆21Updated last year
- Vanilla-Python ergonomics on top of DSPy☆39Updated 8 months ago
- Web Interface for Vision Language Models Including InternVLM2☆25Updated last year
- Structured outputs from DSPy and Jinja2☆27Updated 7 months ago
- Verbosity control for AI agents☆66Updated last year
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Updated last year
- A cookiecutter template for building plugins for LLM☆29Updated 2 months ago
- LLM plugin for embeddings using sentence-transformers☆74Updated 9 months ago
- Contains the model patches and the eval logs from the passing swe-bench-lite run.☆10Updated last year
- Handout for a talk I gave about LLM and CLI tools☆62Updated last year
- A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.☆90Updated last year
- Public reports detailing responses to sets of prompts by Large Language Models.☆32Updated last year
- Tutorial and template for a semantic search app powered by the Atlas Embedding Database, Langchain, OpenAI and FastAPI☆114Updated 2 years ago
- A FastAPI extension for integrating common AI agent frameworks.☆47Updated last year
- ☆17Updated 7 months ago
- The official Python library for Formulaic☆18Updated last year
- A framework for building large-scale, deterministic, interactive workflows with a fault-tolerant, conversational UX☆44Updated this week
- Task management for AI agents☆15Updated 7 months ago
- examples and guides to using Nomic Atlas☆37Updated 9 months ago
- Code Interpreter Replica☆26Updated 2 years ago
- Demo of knowledge graph creation and Graph RAG with BAML and Kuzu☆73Updated 4 months ago
- Using modal.com to process FineWeb-edu data☆20Updated 10 months ago