Alternatives and similar repositories for institutional-books-1-pipeline

Users that are interested in institutional-books-1-pipeline are comparing it to the libraries listed below

• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆66Updated last year
• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆52Updated last month
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 10 months ago
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆31Updated last year
• cgftinc / benchmax
  Framework-Agnostic RL Environments for LLM Fine-Tuning
  ☆35Updated this week
• eliahuhorwitz / Model-Atlas
  ☆28Updated 5 months ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated last year
• jxmorris12 / embzip
  lossily compress representation vectors using product quantization
  ☆59Updated 5 months ago
• codelion / pts
  Pivotal Token Search
  ☆125Updated 2 months ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆62Updated 4 months ago
• epfl-dlab / GPTurk
  ☆29Updated 2 years ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆110Updated 5 months ago
• cfahlgren1 / hf-data-explorer
  Chrome Extension for exploring Hugging Face datasets 🔎
  ☆49Updated last year
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆26Updated 11 months ago
• lancedb / ragged
  ☆20Updated 11 months ago
• mozilla-ai / lm-buddy
  Your buddy in the (L)LM space.
  ☆64Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆132Updated 3 months ago
• simonw / llm-cluster
  LLM plugin for clustering embeddings
  ☆82Updated last year
• AdoHaha / dspy_fun
  An introduction to DSPy
  ☆32Updated 3 weeks ago
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year
• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆25Updated last year
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆87Updated this week
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆55Updated 3 months ago
• babylm / baseline-pretraining
  Code for pre-training BabyLM baseline models.
  ☆16Updated 2 years ago
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆38Updated 6 months ago
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆65Updated last year
• r-three / common-pile
  Code for collecting, processing, and preparing datasets for the Common Pile
  ☆227Updated last week
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆85Updated 2 weeks ago
• allenai / olmo-cookbook
  OLMost every training recipe you need to perform data interventions with the OLMo family of models.
  ☆48Updated this week
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆55Updated 6 months ago