bentoml / transformers-nlp-serviceLinks
Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more
β45Updated last year
Alternatives and similar repositories for transformers-nlp-service
Users that are interested in transformers-nlp-service are comparing it to the libraries listed below
Sorting:
- π Unstructured Data Connectors for Haystack 2.0β17Updated last year
- Text to Python Objects via a LLM Function Callβ58Updated last year
- Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K β¦β83Updated 7 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeedβ35Updated 2 years ago
- Tutorial and template for a semantic search app powered by the Atlas Embedding Database, Langchain, OpenAI and FastAPIβ115Updated last year
- LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. Iβ¦β113Updated 3 weeks ago
- Voyage AI Official Python Libraryβ66Updated 2 weeks ago
- This is the repo for the container that holds the models for the text2vec-transformers moduleβ53Updated this week
- LLM finetuningβ42Updated last year
- Using LlamaIndex with Ray for productionizing LLM applicationsβ71Updated 2 years ago
- β40Updated this week
- β172Updated 5 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.β33Updated 2 months ago
- Deploy and Scale LLM-based applicationsβ26Updated 2 years ago
- Build and Deploy a voice-based Chatbot with Langchain and BentoMLβ18Updated 2 years ago
- Example for Logging LLM Evaluator Prompt Responsesβ18Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models accessβ¦β114Updated last year
- β199Updated last year
- β92Updated last year
- β59Updated last year
- Leverage your LangChain trace data for fine tuningβ42Updated last year
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo rankerβ114Updated 3 weeks ago
- Large Language Model (LLM) Inference API and Chatbotβ126Updated last year
- An open-source cloud-native of large multi-modal models (LMMs) serving framework.β167Updated last year
- β61Updated 2 years ago
- Python API for https://vespa.ai, the open big data serving engineβ135Updated this week
- β56Updated 2 years ago
- π Datasets and models for instruction-tuningβ238Updated last year
- AI_Powered_Dev_Search_Engineβ12Updated last year
- Additional packages (components, document stores and the likes) to extend the capabilities of Haystackβ160Updated this week