Alternatives and similar repositories for institutional-books-1-pipeline

Users that are interested in institutional-books-1-pipeline are comparing it to the libraries listed below

• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆31Updated last year
• dropbox / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆53Updated 2 months ago
• r-three / common-pile
  Code for collecting, processing, and preparing datasets for the Common Pile
  ☆235Updated last month
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆135Updated 5 months ago
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆209Updated last week
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆26Updated last year
• ibm-granite / granite-3.1-language-models
  Granite 3.1 Language Models
  ☆129Updated 4 months ago
• epfl-dlab / GPTurk
  ☆29Updated 2 years ago
• codelion / pts
  Pivotal Token Search
  ☆131Updated 3 months ago
• cfahlgren1 / hf-data-explorer
  Chrome Extension for exploring Hugging Face datasets 🔎
  ☆49Updated last year
• lancedb / ragged
  ☆20Updated last year
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆64Updated 6 months ago
• babylm / baseline-pretraining
  Code for pre-training BabyLM baseline models.
  ☆16Updated 2 years ago
• eliahuhorwitz / Model-Atlas
  ☆31Updated 6 months ago
• liujch1998 / infini-gram
  ☆73Updated 3 months ago
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆57Updated 7 months ago
• cgftinc / benchmax
  Framework-Agnostic RL Environments for LLM Fine-Tuning
  ☆38Updated this week
• simonw / llm-nomic-api-embed
  Create embeddings for LLM using the Nomic API
  ☆23Updated 11 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆25Updated 11 months ago
• codestoryai / swe_bench_traces
  Contains the model patches and the eval logs from the passing swe-bench-lite run.
  ☆10Updated last year
• simonw / docs-for-llms
  Concatenated documentation for use with LLMs
  ☆47Updated this week
• haizelabs / thorn-in-haizestack
  Thorn in a HaizeStack test for evaluating long-context adversarial robustness.
  ☆26Updated last year
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆65Updated last year
• huggingface / dedupe_estimator
  Chunk Dedupe Estimation
  ☆20Updated last year
• thoppe / The-Pile-PhilPapers
  Download, parse, and filter data from Phil Papers. Data-ready for The-Pile.
  ☆18Updated 2 years ago
• dwarvesf / llm-hosting
  This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…
  ☆24Updated 8 months ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆61Updated last month
• jxmorris12 / embzip
  lossily compress representation vectors using product quantization
  ☆59Updated last week
• rmit-ir / walert
  Code and data for the Walert large language model-based chatbot
  ☆12Updated 2 months ago