Alternatives and similar repositories for institutional-books-1-pipeline

Users that are interested in institutional-books-1-pipeline are comparing it to the libraries listed below

• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆57Updated last month
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆25Updated 6 months ago
• morgangiraud / text-to-sql-proto
  A text-to-SQL prototype on the northwind sqlite dataset
  ☆12Updated 9 months ago
• allenai / olmo-cookbook
  OLMost every training recipe you need to perform data interventions with the OLMo family of models.
  ☆32Updated this week
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆24Updated 8 months ago
• guidance-ai / jsonschemabench
  ☆41Updated last week
• explosion / spacy-curated-transformers
  spaCy entry points for Curated Transformers
  ☆31Updated 3 weeks ago
• GraphIndex-org / semantic-mapper
  ☆19Updated last year
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆25Updated 7 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 9 months ago
• liujch1998 / infini-gram
  ☆51Updated 3 weeks ago
• maxdotio / neural-solr
  Neural Solr = Solr 9 + Mighty Inference + Node
  ☆17Updated 3 years ago
• salesforce / simplification
  ☆22Updated 4 months ago
• huggingface / ethics-scripts
  ☆14Updated 2 years ago
• lightonai / ducksearch
  Efficient BM25 with DuckDB 🦆
  ☆49Updated 6 months ago
• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆23Updated last year
• sradc / MakeAgents
  A Python micro framework for creating LLM-driven agents
  ☆23Updated last month
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆23Updated 5 months ago
• darrow-labs / LegalLens
  ☆8Updated 11 months ago
• thoppe / The-Pile-PhilPapers
  Download, parse, and filter data from Phil Papers. Data-ready for The-Pile.
  ☆17Updated last year
• andrewgcodes / vec2vec
  ☆15Updated 2 years ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆62Updated last month
• patronus-ai / copyright-evals
  ☆20Updated last year
• adrienbrault / hermes2pro-proxy
  Use Hermes-2-Pro-Mistral-7B function calling with your OpenAI API compatible code.
  ☆18Updated last year
• lintool / history-of-open-source-ir-systems
  History of Open-Source IR Systems
  ☆11Updated 4 months ago
• mcminis1 / mr-graph
  a graph definition and execution library for python
  ☆16Updated 2 years ago
• alea-institute / nupunkt
  Next-generation Punkt sentence boundary detection with zero dependencies
  ☆17Updated 2 months ago
• raphaelsty / neural-tree
  Tree-based indexes for neural-search
  ☆32Updated last year
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆34Updated 4 years ago
• argilla-io / awesome-llm-datasets
  👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)
  ☆23Updated 2 years ago