dwarvesf / llm-hostingLinks
This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Large Language Models with an OpenAI compatible vLLM server.
☆24Updated 7 months ago
Alternatives and similar repositories for llm-hosting
Users that are interested in llm-hosting are comparing it to the libraries listed below
Sorting:
- Chrome Extension for exploring Hugging Face datasets 🔎☆48Updated last year
- Embedding models from Jina AI☆65Updated last year
- Paste Word, get Markdown☆16Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆25Updated 10 months ago
- Voyage AI Official Python Library☆78Updated 3 weeks ago
- Handout for a talk I gave about LLM and CLI tools☆62Updated last year
- The official Python library for Formulaic☆16Updated last year
- A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.☆87Updated 10 months ago
- A cookiecutter template for building plugins for LLM☆28Updated 6 months ago
- watch your screen while doing sales and fill your crm automatically☆16Updated last year
- ☆20Updated 11 months ago
- A collection of tools for your LLMs that run on Modal☆22Updated 7 months ago
- LLM plugin for clustering embeddings☆82Updated last year
- Verbosity control for AI agents☆65Updated last year
- Demo of knowledge graph creation and Graph RAG with BAML and Kuzu☆72Updated 3 weeks ago
- Use sync mode Playwright interactively, inside a Jupyter notebook☆15Updated 6 months ago
- Web Interface for Vision Language Models Including InternVLM2☆23Updated last year
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆34Updated 5 months ago
- Tools for formatting large language model prompts.☆13Updated last year
- ☆20Updated last year
- Chat Markup Language conversation library☆55Updated last year
- A curated collection of example marimo notebooks — use these as templates for your own experiments, workflows, and tools.☆52Updated this week
- Using modal.com to process FineWeb-edu data☆20Updated 6 months ago
- Leverage your LangChain trace data for fine tuning☆46Updated last year
- 📚 Build knowledge bases for RAG☆28Updated 3 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- Contains the model patches and the eval logs from the passing swe-bench-lite run.☆10Updated last year
- An introduction to DSPy☆32Updated last month
- LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…☆116Updated 2 months ago
- Adding NeMo Guardrails to a LlamaIndex RAG pipeline☆41Updated last year