Alternatives and similar repositories for Crawl

Users that are interested in Crawl are comparing it to the libraries listed below

• Tanh-wink / es_search

  View on GitHub
  python class for elasticsearch , including add, batch add, update, delete, query, and scan query. also with a demo that put Wikipedia in…
  ☆17Sep 3, 2022Updated 3 years ago
• Tanh-wink / Chid_Bert_baseline

  View on GitHub
  A based-bert baseline for Chinese idiom cloze test with pytorch.
  ☆18Dec 24, 2020Updated 5 years ago
• Tanh-wink / tf-idf

  View on GitHub
  tf-idf 模型封装类，包含计算所有文档的tf-idf值，实现了基于tf-idf搜索引擎功能。根据query，计算与每个文档的相似度，返回与query相似度最高的topk文档
  ☆16Nov 20, 2020Updated 5 years ago
• Tanh-wink / semantic-similarity

  View on GitHub
  semantic similarity， word2vec + wmd， bert+wmd， pytorch
  ☆31Jan 29, 2024Updated 2 years ago
• Tanh-wink / NCPQA

  View on GitHub
  Datafountain-Epidemic government affairs quiz assistant competition. We divided this task into two parts: document retrieval and answer e…
  ☆14Aug 21, 2022Updated 3 years ago
• wptoux / yqzwqa

  View on GitHub
  DataFountain 疫情政务问答助手解决方案分享
  ☆16May 2, 2020Updated 5 years ago
• nilboy / reports

  View on GitHub
  文档记录
  ☆15Mar 16, 2021Updated 4 years ago
• wangwang110 / CSC

  View on GitHub
  ChineseBert用于中文拼写纠错
  ☆43Mar 14, 2023Updated 2 years ago
• llmeval / LLMEval-2

  View on GitHub
  中文大语言模型评测第二期
  ☆71Oct 23, 2023Updated 2 years ago
• Felixgithub2017 / MMCU

  View on GitHub
  MEASURING MASSIVE MULTITASK CHINESE UNDERSTANDING
  ☆89Mar 24, 2024Updated last year
• freefuiiismyname / capsule-mrc

  View on GitHub
  基于capsule的观点型阅读理解模型
  ☆88Aug 8, 2019Updated 6 years ago
• YingZiqiang / LES-MMRC-Summary

  View on GitHub
  科赛网-莱斯杯：全国第二届“军事智能机器阅读”挑战赛 前十团队PPT文档代码总结
  ☆132Feb 5, 2020Updated 6 years ago
• NoneWait / cail2019

  View on GitHub
  法研杯2019 阅读理解赛道 top3
  ☆151Nov 13, 2023Updated 2 years ago
• jiesutd / RichWordSegmentor

  View on GitHub
  Neural word segmentation with rich pretraining, code for ACL 2017 paper
  ☆164Jan 10, 2019Updated 7 years ago
• bitextor / bicleaner

  View on GitHub
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆160Jun 18, 2024Updated last year
• ZhuiyiTechnology / nl2sql_baseline

  View on GitHub
  ☆368Jul 19, 2023Updated 2 years ago
• v-mipeng / LexiconAugmentedNER

  View on GitHub
  Reject complicated operations for incorporating lexicon for Chinese NER.
  ☆437Jan 22, 2022Updated 4 years ago
• CLUEbenchmark / KgCLUE

  View on GitHub
  KgCLUE: 大规模中文开源知识图谱问答
  ☆455Jul 5, 2022Updated 3 years ago
• ZhuiyiTechnology / WoBERT

  View on GitHub
  以词为基本单位的中文BERT
  ☆474Nov 18, 2021Updated 4 years ago
• HillZhang1999 / MuCGEC

  View on GitHub
  MuCGEC中文纠错数据集及文本纠错SOTA模型开源；Code & Data for our NAACL 2022 Paper "MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Gr…
  ☆563Jun 9, 2023Updated 2 years ago
• thunlp / TensorFlow-TransX

  View on GitHub
  An implementation of TransE and its extended models for Knowledge Representation Learning on TensorFlow
  ☆513Nov 3, 2022Updated 3 years ago
• SqueezeAILab / SqueezeLLM

  View on GitHub
  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
  ☆713Aug 13, 2024Updated last year
• pltrdy / rouge

  View on GitHub
  A full Python Implementation of the ROUGE Metric (not a wrapper)
  ☆715Nov 19, 2024Updated last year
• zhezhaoa / ngram2vec

  View on GitHub
  Four word embedding models implemented in Python. Supporting arbitrary context features
  ☆848Aug 22, 2019Updated 6 years ago
• IST-DASLab / marlin

  View on GitHub
  FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
  ☆1,011Sep 4, 2024Updated last year
• thunlp / RCPapers

  View on GitHub
  Must-read papers on Machine Reading Comprehension
  ☆891Jul 9, 2020Updated 5 years ago
• THUDM / LongBench

  View on GitHub
  LongBench v2 and LongBench (ACL 25'&24')
  ☆1,093Jan 15, 2025Updated last year
• localminimum / QANet

  View on GitHub
  A Tensorflow implementation of QANet for machine reading comprehension
  ☆983May 30, 2018Updated 7 years ago
• yaodongC / awesome-instruction-dataset

  View on GitHub
  A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)
  ☆1,143Jan 4, 2024Updated 2 years ago
• allenai / bi-att-flow

  View on GitHub
  Bi-directional Attention Flow (BiDAF) network is a multi-stage hierarchical process that represents context at different levels of granul…
  ☆1,540May 31, 2023Updated 2 years ago
• google-research / language

  View on GitHub
  Shared repository for open-sourced projects from the Google AI Language team.
  ☆1,746Feb 5, 2026Updated last week
• DQinYuan / chinese_province_city_area_mapper

  View on GitHub
  一个用于提取简体中文字符串中省，市和区并能够进行映射，检验和简单绘图的python模块
  ☆1,776Mar 19, 2024Updated last year
• hkust-nlp / ceval

  View on GitHub
  Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]
  ☆1,812Jul 27, 2025Updated 6 months ago
• imcaspar / gpt2-ml

  View on GitHub
  GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型
  ☆1,705May 22, 2023Updated 2 years ago
• intel / intel-extension-for-transformers

  View on GitHub
  ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…
  ☆2,174Oct 8, 2024Updated last year
• neuralmagic / sparseml

  View on GitHub
  Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
  ☆2,144Jun 2, 2025Updated 8 months ago
• TingFree / NLPer-Arsenal

  View on GitHub
  收录NLP竞赛策略实现、各任务baseline、相关竞赛经验贴（当前赛事、往期赛事、训练赛）、NLP会议时间、常用自媒体、GPU推荐等，持续更新中
  ☆2,239Aug 29, 2023Updated 2 years ago
• GanjinZero / awesome_Chinese_medical_NLP

  View on GitHub
  中文医学NLP公开资源整理：术语集/语料库/词向量/预训练模型/知识图谱/命名实体识别/QA/信息抽取/模型/论文/etc
  ☆2,534Jan 17, 2024Updated 2 years ago
• FreedomIntelligence / Awesome-AI4Med

  View on GitHub
  [Medical_NLP ➟ Awesome-AI4Med] medical-related LLMs, Multimodal systems, Datasets, Benchmarks, and more.
  ☆2,516Feb 6, 2026Updated last week