dwarvesf / llm-hostingLinks
This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Large Language Models with an OpenAI compatible vLLM server.
☆24Updated 8 months ago
Alternatives and similar repositories for llm-hosting
Users that are interested in llm-hosting are comparing it to the libraries listed below
Sorting:
- Chrome Extension for exploring Hugging Face datasets 🔎☆49Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆25Updated last year
- Tools for formatting large language model prompts.☆13Updated last year
- Embedding models from Jina AI☆65Updated last year
- Voyage AI Official Python Library☆81Updated 2 months ago
- LLM plugin for clustering embeddings☆82Updated last year
- Chat Markup Language conversation library☆55Updated last year
- The official Python library for Formulaic☆17Updated last year
- Paste Word, get Markdown☆17Updated last year
- ☆21Updated last year
- A swarm of LLM agents that will help you test, document, and productionize your code!☆16Updated 3 weeks ago
- Using modal.com to process FineWeb-edu data☆20Updated 7 months ago
- Run models distributed as GGUF files using LLM☆79Updated 11 months ago
- Contains the model patches and the eval logs from the passing swe-bench-lite run.☆10Updated last year
- A framework for building large-scale, deterministic, interactive workflows with a fault-tolerant, conversational UX☆42Updated this week
- Code Interpreter Replica☆25Updated 2 years ago
- Create an LLM XML context document from an llms.txt file☆22Updated last year
- Adapter / facade for language models (OpenAI, Anthropic, Cohere, local transformers, etc)☆20Updated 2 years ago
- Task management for AI agents☆15Updated 4 months ago
- A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.☆89Updated 11 months ago
- A collection of tools for your LLMs that run on Modal☆22Updated 8 months ago
- MindMapper is an innovative program that empowers intelligent agents to navigate complex thought landscapes and collaboratively map their…☆29Updated 2 weeks ago
- Verbosity control for AI agents☆64Updated last year
- Use sync mode Playwright interactively, inside a Jupyter notebook☆16Updated 7 months ago
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆42Updated last year
- scraping and querying documents for LLMs☆24Updated last month
- Handout for a talk I gave about LLM and CLI tools☆62Updated last year
- Demo of knowledge graph creation and Graph RAG with BAML and Kuzu☆72Updated 2 months ago
- ☆20Updated last year
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Updated last year