Alternatives and similar repositories for institutional-books-1-pipeline

Users that are interested in institutional-books-1-pipeline are comparing it to the libraries listed below

• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆30Updated 2 years ago
• dropbox / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆55Updated 4 months ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆26Updated last year
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆67Updated 8 months ago
• allenai / duplodocus
  Tooling for exact and MinHash deduplication of large-scale text datasets
  ☆52Updated this week
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• codelion / pts
  Pivotal Token Search
  ☆142Updated last month
• allenai / decon
  decontamination
  ☆21Updated last month
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆138Updated 7 months ago
• jxmorris12 / embzip
  lossily compress representation vectors using product quantization
  ☆59Updated 2 months ago
• lancedb / ragged
  ☆21Updated last year
• r-three / common-pile
  Code for collecting, processing, and preparing datasets for the Common Pile
  ☆247Updated 4 months ago
• cfahlgren1 / hf-data-explorer
  Chrome Extension for exploring Hugging Face datasets 🔎
  ☆48Updated last year
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated last year
• eliahuhorwitz / Model-Atlas
  ☆33Updated 9 months ago
• mungg / FABLES
  ☆59Updated last year
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆94Updated 4 months ago
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆43Updated 2 years ago
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆39Updated 10 months ago
• mlcommons / ailuminate
  The AILuminate v1.1 benchmark suite is an AI risk assessment benchmark developed with broad involvement from leading AI companies, academ…
  ☆65Updated 7 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated last year
• Snowflake-Labs / arctic-embed
  ☆82Updated 2 months ago
• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆25Updated last year
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆77Updated 5 months ago
• allenai / infinigram-api
  ☆92Updated last month
• salesforce / simplification
  ☆23Updated 11 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated 11 months ago
• google-deepmind / xtr
  XTR: Rethinking the Role of Token Retrieval in Multi-Vector Retrieval
  ☆61Updated last year
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆82Updated last year
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated 2 years ago