Alternatives and similar repositories for nucleus

Users that are interested in nucleus are comparing it to the libraries listed below

• modal-labs / ci-on-modal
  A sample pattern for running CI tests on Modal
  ☆18Updated 3 months ago
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• yiyixuxu / n-grammer-flax
  Implementation of N-Grammer in Flax
  ☆17Updated 2 years ago
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆34Updated 4 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated 2 years ago
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆17Updated 3 months ago
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated 2 weeks ago
• mariosasko / datasets_sql
  Execute arbitrary SQL queries on 🤗 Datasets
  ☆32Updated last year
• qdrant / quaterion-models
  The collection of bulding blocks building fine-tunable metric learning models
  ☆32Updated 3 months ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 9 months ago
• alvarobartt / vertex-ai-huggingface-inference-toolkit
  🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
  ☆17Updated last year
• Narsil / bloomserver
  ☆39Updated 2 years ago
• daveshap / GibberishDetector
  Detecting gibberish as a type of sentiment analysis with GPT2
  ☆24Updated 4 years ago
• jxnl / instructor-classify
  ☆35Updated 2 months ago
• philschmid / optimum-static-quantization
  ☆28Updated 2 years ago
• loretoparisi / hf-experiments
  Experiments with Hugging Face 🔬 🤗
  ☆44Updated 10 months ago
• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆22Updated 2 years ago
• dm4ml / motion
  Framework for building and maintaining self-updating prompts for LLMs
  ☆64Updated last year
• trisongz / pylines
  Simplifying parsing of large jsonline files in NLP Workflows
  ☆12Updated 3 years ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• tchaton / pytorch2lightning
  ☆15Updated 3 years ago
• calum-bird / howmanyparams.com
  Compute-optimal LLMs
  ☆11Updated 2 years ago
• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆33Updated last year
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆24Updated 9 months ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated last year
• awslabs / extending-the-context-length-of-open-source-llms
  ☆55Updated 2 weeks ago
• allenai / cached_path
  A file utility for accessing both local and remote files through a unified interface.
  ☆43Updated 2 months ago
• bentoml / aws-lambda-deploy
  Fast model deployment on AWS Lambda
  ☆14Updated last year
• huggingface / disaggregators
  🤗 Disaggregators: Curated data labelers for in-depth analysis.
  ☆66Updated 2 years ago