本项目旨在对大量文本文件进行快速编码检测和转换以辅助mnbvc语料集项目的数据清洗工作
☆71Sep 11, 2026Updated 2 months ago
Alternatives and similar repositories for charset_mnbvc
Users that are interested in charset_mnbvc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 文本去重☆76May 23, 2024Updated 2 years ago
- this repo is mnbvc text quality classification using fastText☆16Oct 2, 2023Updated 3 years ago
- ☆11Apr 10, 2023Updated 3 years ago
- MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化,也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志…☆4,307Oct 25, 2026Updated 3 weeks ago
- MNVBC项目裁判文书的清洗代码☆12Sep 11, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- implementation of https://arxiv.org/pdf/2312.09299☆21Jul 3, 2024Updated 2 years ago
- 更纯粹、更高压缩率的Tokenizer☆489Nov 27, 2024Updated last year
- Extract Chinese/English QA Data from WikiHow pages.☆17May 21, 2023Updated 3 years ago
- Code used for sourcing and cleaning the BigScience ROOTS corpus☆319Mar 20, 2023Updated 3 years ago
- Train a Long-Short Term Memory neural network to write the Poetry of Tang Dynasty☆11Nov 20, 2018Updated 8 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆69Jul 20, 2023Updated 3 years ago
- 使用ndk进行MD5加密☆32Sep 16, 2026Updated 2 months ago
- ☆19May 11, 2024Updated 2 years ago
- 一个轻量级神经符号融合框架,通过结合小型语言模型与符号推理系统,在资源受限环境中实现高质量的逻辑推理能力。☆24Mar 2, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Implementing BERT + CRF with PyTorch for Chinese NER.☆10Mar 7, 2022Updated 4 years ago
- Vocabulary Trimming (VT) is a model compression technique, which reduces a multilingual LM vocabulary to a target language by deleting ir…☆70Oct 25, 2024Updated 2 years ago
- ☆33Feb 9, 2025Updated last year
- An example of multi-GPU, multi-node training under SLURM with MONAI☆12Mar 15, 2022Updated 4 years ago
- OneFlow Serving☆20Apr 10, 2025Updated last year
- A package containing utils for the PyTorch version of the Tapas algorithm.☆11Apr 29, 2021Updated 5 years ago
- A lightweight Python tool to analyze PCAP files and generate network traffic reports. It detects traffic patterns, security concerns, and…☆19Sep 25, 2024Updated 2 years ago
- Asynchronous Python wrapper for the GPTZero API☆29Jan 9, 2024Updated 2 years ago
- RGCN model for real-time fraud detection☆11Jan 27, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- [DAC2024] Explainable Fuzzy Neural Network with Multi-Fidelity Reinforcement Learning for Micro-Architecture Design Space Exploration☆10Jul 21, 2026Updated 3 months ago
- INSET: Sentence Infilling with Inter-sentential Transformer☆30Nov 21, 2020Updated 5 years ago
- Implementation of DTMT with incremental decoding☆13Feb 20, 2021Updated 5 years ago
- 该资源是安全和AI论文相关会议和期刊汇总,希望对您有所帮助~☆11Jan 6, 2021Updated 5 years ago
- Code for the paper "Fuzzy c-Means Clustering for Persistence Diagrams"☆14Oct 14, 2023Updated 3 years ago
- ☆32Jun 5, 2025Updated last year
- [EMNLP 2023] Official implementation of the algorithm ETSC: Exact Toeplitz-to-SSM Conversion our EMNLP 2023 paper - Accelerating Toeplitz…☆14Oct 17, 2023Updated 3 years ago
- Yoeman project generator to create an Electron app running a Flask server inside itself. Deployable via PyInstaller and Electron Forge pa…☆12Jun 29, 2021Updated 5 years ago
- Code for Auditing Data Provenance in Text-Generation Models (in KDD 2019)☆10Jun 18, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Fine-tuned BERT on SQuAd 2.0 Dataset. Applied Knowledge Distillation (KD) and fine-tuned DistilBERT (student) using BERT as the teacher m…☆26Feb 13, 2021Updated 5 years ago
- Dsure Front-end Development Framework ( Ultimate Personal Learning Edition 2014 )☆14Dec 28, 2016Updated 9 years ago
- ☆13Jan 20, 2023Updated 3 years ago
- The code of ACL2022 paper "Conditional Bilingual Mutual Information based Adaptive Training for Neural Machine Translation"..☆14Aug 6, 2022Updated 4 years ago
- [COLING 2022] CSL: A Large-scale Chinese Scientific Literature Dataset 中文科学文献数据集☆672Jun 19, 2023Updated 3 years ago
- 金山文档多渠道消息推送器,兼容airscript1.0和2.0。金山文档的消息推送,支持Bark、pushplus、Server 酱、邮箱、钉钉、discord、企业微信群机器人、息知、即时达、wxpusher☆14Apr 4, 2025Updated last year
- Toxic Comment Classification on Wikipedia Comments dataset.☆10May 5, 2019Updated 7 years ago
Are these results useful?