bentoml / sentence-embedding-bento
Sentence Embedding as a Service
☆14Updated 10 months ago
Related projects: ⓘ
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆27Updated last year
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆34Updated 3 weeks ago
- ☆36Updated last year
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆13Updated 8 months ago
- Cortex-compatible model server for Python and TensorFlow☆16Updated last year
- The collection of bulding blocks building fine-tunable metric learning models☆31Updated 2 months ago
- Experiments w/ ChatGPT, LangChain, local LLMs☆24Updated last year
- A file utility for accessing both local and remote files through a unified interface.☆36Updated last month
- ☆20Updated 7 months ago
- Simple dependency injection framework for Python☆21Updated 4 months ago
- setup the env for vllm users☆16Updated 10 months ago
- Rust bindings for CTranslate2☆13Updated last year
- Open sourced backend for Martian's LLM Inference Provider Leaderboard☆15Updated last month
- implementation of https://arxiv.org/pdf/2312.09299☆19Updated 2 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆23Updated last week
- Local emulator for Hugging Face Inference Endpoints customer handlers☆24Updated last year
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated last year
- A collection of pre-build wrappers over common RAG systems like ChromaDB, Weaviate, Pinecone, and othersz!☆12Updated last week
- ☆12Updated last year
- ☆25Updated this week
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆22Updated 6 months ago
- A streamlit app for visualizing LLM evals.☆38Updated 8 months ago
- Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"☆15Updated last week
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆21Updated last year
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆33Updated last year
- **ARCHIVED** Filesystem interface to 🤗 Hub☆56Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆26Updated last year
- API serving for your diffusers models☆10Updated 8 months ago
- Data preparation code for CrystalCoder 7B LLM☆42Updated 4 months ago
- A library for squeakily cleaning and filtering language datasets.☆45Updated last year