Alternatives and similar repositories for UnifiedCrawl:

Users that are interested in UnifiedCrawl are comparing it to the libraries listed below

• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆21Updated last year
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆49Updated 2 weeks ago
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆21Updated 3 months ago
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 7 months ago
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 weeks ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year
• LAGoM-NLP / transtokenizer
  ☆42Updated last month
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆61Updated 9 months ago
• XiaoduoAILab / XmodelLM
  XmodelLM
  ☆39Updated 4 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 4 months ago
• YutongWang1216 / DocMTAgent
  Code and data releases for the paper -- DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory
  ☆37Updated last month
• arcee-ai / DAM
  ☆48Updated 4 months ago
• Zyphra / transformers_zamba2
  ☆45Updated last month
• cognitivecomputations / chat-logger
  ☆51Updated 4 months ago
• lightblue-tech / lb-reranker
  ☆20Updated last month
• Aleph-Alpha / trigrams
  ☆52Updated 6 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆31Updated 3 weeks ago
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆76Updated 5 months ago
• rosewang2008 / posr
  Problem-Oriented Segmentation and Retrieval EMNLP 2024 Findings
  ☆30Updated 4 months ago
• iulia-b10 / multilingual-embedding-models
  ☆20Updated last year
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆67Updated 6 months ago
• jkallini / mrt5
  Code repository for the paper "MrT5: Dynamic Token Merging for Efficient Byte-level Language Models."
  ☆34Updated last week
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated 11 months ago
• r-three / common-pile
  Repo to hold code and track issues for the collection of permissively licensed data
  ☆23Updated last week
• Pleias / marginalia
  ☆67Updated last year
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆35Updated 10 months ago
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆64Updated last week