alvarobartt / vertex-ai-huggingface-inference-toolkit
🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
☆17Updated last year
Alternatives and similar repositories for vertex-ai-huggingface-inference-toolkit:
Users that are interested in vertex-ai-huggingface-inference-toolkit are comparing it to the libraries listed below
- Using short models to classify long texts☆21Updated 2 years ago
- Pre-train Static Word Embeddings☆49Updated 2 weeks ago
- NLP with Rust for Python 🦀🐍☆61Updated 9 months ago
- 🤝 Trade any tensors over the network☆30Updated last year
- Versatile framework designed to streamline the integration of your models, as well as those sourced from Hugging Face, into complex progr…☆28Updated 3 months ago
- Library for fast text representation and classification.☆28Updated last year
- A library for squeakily cleaning and filtering language datasets.☆46Updated last year
- Tools to make language models a bit easier to use☆39Updated 2 weeks ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- PyTorch implementation for MRL☆18Updated last year
- QLoRA for Masked Language Modeling☆21Updated last year
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆38Updated 11 months ago
- Code for SaGe subword tokenizer (EACL 2023)☆24Updated 3 months ago
- Source code and data for Like a Good Nearest Neighbor☆28Updated 2 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- ☆24Updated last year
- ☆15Updated last year
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…☆42Updated last year
- ☆47Updated last year
- Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval☆14Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆29Updated 5 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆34Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆59Updated last year
- SpaCyEx allows the creation of spaCy Matcher patterns with RegEx like syntax.☆59Updated 10 months ago
- Embedding Recycling for Language models☆38Updated last year
- A Python library aimed at dissecting and augmenting NER training data.☆58Updated last year
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆25Updated 3 months ago
- ☆21Updated last month
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆22Updated 2 years ago