Alternatives and similar repositories for UnifiedCrawl

Users that are interested in UnifiedCrawl are comparing it to the libraries listed below

• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last month
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 9 months ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆49Updated 2 weeks ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆43Updated 3 months ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆48Updated last week
• apehex / tokun
  Tokun to can tokens
  ☆17Updated last week
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆60Updated last month
• mungg / FABLES
  ☆57Updated 7 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 6 months ago
• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆21Updated last year
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆62Updated this week
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆76Updated 6 months ago
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆22Updated 5 months ago
• Knowledgator / LiqFit
  Efficient few-shot learning with cross-encoders.
  ☆52Updated last year
• arcee-ai / DAM
  ☆48Updated 6 months ago
• AnswerDotAI / fastkmeans
  ☆53Updated this week
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆64Updated 9 months ago
• cg123 / rathe
  Tools for formatting large language model prompts.
  ☆13Updated last year
• JustlyAI / lmss_entity_extractor
  Tool to apply Legal Matter Specification Standard (LMSS) to documents
  ☆13Updated 9 months ago
• LAGoM-NLP / transtokenizer
  ☆45Updated 3 months ago
• XiaoduoAILab / XmodelLM
  XmodelLM
  ☆39Updated 5 months ago
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆72Updated last week
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• unicamp-dl / InRanker
  ☆47Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆53Updated 3 months ago
• nyunAI / PruneGPT
  ☆53Updated 11 months ago
• jfkback / hypencoder-paper
  Official Repository for "Hypencoder: Hypernetworks for Information Retrieval"
  ☆24Updated 2 months ago
• pgasawa / BARE
  Combining Base and Instruction-Tuned Language Models for Better Synthetic Data Generation
  ☆29Updated 3 months ago
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆25Updated 5 months ago