Alternatives and similar repositories for UnifiedCrawl

Users that are interested in UnifiedCrawl are comparing it to the libraries listed below

• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆23Updated last year
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 7 months ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆57Updated last month
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆47Updated 4 months ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆59Updated last month
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 10 months ago
• mwatkins1970 / SAE_Feature_Interpretability_Tool
  A tool to assist in the interpretation of learned features in sparse autoencoders (in particular the four SAE's trained by Joseph Bloom o…
  ☆19Updated 8 months ago
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆75Updated 8 months ago
• AnswerDotAI / fastkmeans
  ☆61Updated last week
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆54Updated 4 months ago
• apehex / tokun
  Tokun to can tokens
  ☆17Updated last week
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆74Updated last month
• XiaoduoAILab / XmodelLM
  XmodelLM
  ☆39Updated 7 months ago
• Pleias / marginalia
  ☆67Updated last year
• YutongWang1216 / DocMTAgent
  Code and data releases for the paper -- DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory
  ☆44Updated 4 months ago
• datavistics / encoder-analysis
  Analysis on the cost of encoder based models
  ☆11Updated 4 months ago
• LAGoM-NLP / transtokenizer
  ☆48Updated 5 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 4 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆80Updated 3 weeks ago
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆25Updated 7 months ago
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆22Updated 7 months ago
• cognitivecomputations / SystemChat
  ☆30Updated 11 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆20Updated 6 months ago
• JustlyAI / lmss_entity_extractor
  Tool to apply Legal Matter Specification Standard (LMSS) to documents
  ☆13Updated 10 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆80Updated last month
• awslabs / extending-the-context-length-of-open-source-llms
  ☆55Updated this week
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆38Updated 4 months ago