bentoml / sentence-embedding-bentoLinks
Sentence Embedding as a Service
☆15Updated 6 months ago
Alternatives and similar repositories for sentence-embedding-bento
Users that are interested in sentence-embedding-bento are comparing it to the libraries listed below
Sorting:
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- Cortex-compatible model server for Python and TensorFlow☆17Updated 3 years ago
- Demo example of consumer goods categorization☆30Updated 2 years ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Updated 3 months ago
- ☆82Updated 2 months ago
- The backend behind the LLM-Perf Leaderboard☆11Updated last year
- 🚂 Fine-tune OpenAI models for text classification, question answering, and more☆17Updated 2 years ago
- MLFlow Deployment Plugin for Ray Serve☆46Updated 3 years ago
- Simple dependency injection framework for Python☆21Updated last year
- Vector Database with support for late interaction and token level embeddings.☆54Updated 6 months ago
- ☆39Updated 3 years ago
- ☆56Updated 6 months ago
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 10 months ago
- Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…☆40Updated 3 months ago
- setup the env for vllm users☆16Updated 2 years ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆89Updated last month
- **ARCHIVED** Filesystem interface to 🤗 Hub☆58Updated 2 years ago
- A collection of reproducible inference engine benchmarks☆38Updated 8 months ago
- ☆12Updated last week
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Updated 3 years ago
- A file utility for accessing both local and remote files through a unified interface.☆46Updated last month
- Small python package to measure OCR quality and other related metrics.☆25Updated last year
- ☆21Updated last year
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆36Updated 2 years ago
- Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"☆66Updated 2 years ago
- Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K …☆86Updated last year
- 🤝 Trade any tensors over the network☆30Updated 2 years ago
- Creating Generative AI Apps which work☆17Updated 9 months ago
- Deploy and Scale LLM-based applications☆26Updated 2 years ago
- Tutorial on how to convert machine learned models into ONNX☆16Updated 2 years ago