bentoml / sentence-embedding-bentoLinks
Sentence Embedding as a Service
☆15Updated 4 months ago
Alternatives and similar repositories for sentence-embedding-bento
Users that are interested in sentence-embedding-bento are comparing it to the libraries listed below
Sorting:
- Cortex-compatible model server for Python and TensorFlow☆17Updated 2 years ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated last month
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 8 months ago
- The backend behind the LLM-Perf Leaderboard☆11Updated last year
- Demo example of consumer goods categorization☆30Updated last year
- Creating Generative AI Apps which work☆17Updated 7 months ago
- ☆39Updated 3 years ago
- MLFlow Deployment Plugin for Ray Serve☆46Updated 3 years ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆36Updated 2 years ago
- ☆55Updated 4 months ago
- ☆79Updated last week
- Vector Database with support for late interaction and token level embeddings.☆55Updated 4 months ago
- 🚂 Fine-tune OpenAI models for text classification, question answering, and more☆17Updated 2 years ago
- A file utility for accessing both local and remote files through a unified interface.☆44Updated last month
- This is the repo for the container that holds the models for the text2vec-transformers module☆57Updated last week
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆88Updated last month
- **ARCHIVED** Filesystem interface to 🤗 Hub☆58Updated 2 years ago
- A collection of reproducible inference engine benchmarks☆37Updated 6 months ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆65Updated last year
- Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.☆102Updated last year
- Simple dependency injection framework for Python☆21Updated last year
- Open sourced backend for Martian's LLM Inference Provider Leaderboard☆19Updated last year
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆44Updated last year
- Deploy and Scale LLM-based applications☆26Updated 2 years ago
- Model implementation for the contextual embeddings project☆36Updated 5 months ago
- Evaluation of bm42 sparse indexing algorithm☆72Updated last year
- Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K …☆83Updated 10 months ago
- experiments with inference on llama☆103Updated last year
- Tools for formatting large language model prompts.☆13Updated last year