Alternatives and similar repositories for institutional-books-1-pipeline

Users that are interested in institutional-books-1-pipeline are comparing it to the libraries listed below

• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆52Updated last week
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆66Updated last year
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆31Updated last year
• simonw / llm-cluster
  LLM plugin for clustering embeddings
  ☆81Updated last year
• r-three / common-pile
  Code for collecting, processing, and preparing datasets for the Common Pile
  ☆222Updated last week
• cfahlgren1 / hf-data-explorer
  Chrome Extension for exploring Hugging Face datasets 🔎
  ☆49Updated 11 months ago
• google-deepmind / multiscope
  Real-time visualisation
  ☆18Updated this week
• allenai / olmo-cookbook
  OLMost every training recipe you need to perform data interventions with the OLMo family of models.
  ☆44Updated this week
• vl2g / floco
  Flow Chart Image-to-Code Generation
  ☆34Updated 2 years ago
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆54Updated 5 months ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆61Updated 4 months ago
• codelion / pts
  Pivotal Token Search
  ☆123Updated last month
• jxmorris12 / embzip
  lossily compress representation vectors using product quantization
  ☆59Updated 4 months ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated 11 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆131Updated 2 months ago
• mozilla-ai / lm-buddy
  Your buddy in the (L)LM space.
  ☆64Updated 11 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 6 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 9 months ago
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆104Updated 4 months ago
• cgftinc / benchmax
  Framework-Agnostic RL Environments for LLM Fine-Tuning
  ☆33Updated last week
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆26Updated 10 months ago
• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆25Updated last year
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆64Updated last year
• patronus-ai / copyright-evals
  ☆21Updated last year
• lightonai / pylate-rs
  PyLate efficient inference engine
  ☆64Updated last month
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆40Updated last year
• ibm-granite / granite-3.1-language-models
  Granite 3.1 Language Models
  ☆120Updated 2 months ago
• lancedb / ragged
  ☆20Updated 10 months ago
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆55Updated 2 months ago