stephantul / skeletokenLinks
Datamodels for hugging face tokenizers
β47Updated this week
Alternatives and similar repositories for skeletoken
Users that are interested in skeletoken are comparing it to the libraries listed below
Sorting:
- NLP with Rust for Python π¦πβ64Updated 4 months ago
- β69Updated 2 months ago
- π€ Trade any tensors over the networkβ30Updated last year
- Pre-train Static Word Embeddingsβ85Updated this week
- Trully flash implementation of DeBERTa disentangled attention mechanism.β63Updated last week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.β33Updated 4 months ago
- β49Updated 7 months ago
- Seemless interface of using PyTOrch distributed with Jupyter notebooksβ44Updated last week
- β83Updated 3 months ago
- minimal pytorch implementation of bm25 (with sparse tensors)β104Updated last year
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and teβ¦β42Updated last year
- Python library to use Pleias-RAG modelsβ61Updated 4 months ago
- π Reference-Free automatic summarization evaluation with potential hallucination detectionβ103Updated last year
- Optimus is a flexible and scalable framework built to train language models efficiently across diverse hardware configurations, includingβ¦β67Updated 2 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching oβ¦β147Updated 2 months ago
- Crispy reranking models by Mixedbreadβ35Updated 2 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing β‘β67Updated 10 months ago
- PyLate efficient inference engineβ64Updated last month
- Generalist and Lightweight Model for Text Classificationβ156Updated 3 months ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created byβ¦β32Updated last year
- Command Line Interface for Hugging Face Inference Endpointsβ66Updated last year
- β31Updated 10 months ago
- β42Updated 4 months ago
- ππ€ A collection of templates for Hugging Face Spacesβ35Updated last year
- Small python package to measure OCR quality and other related metrics.β25Updated last year
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).β80Updated last year
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.β84Updated 2 weeks ago
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, impβ¦β189Updated last year
- Hugging Face Jobsβ19Updated 2 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimizationβ65Updated last year