本项目旨在对大量文本文件进行快速编码检测和转换以辅助mnbvc语料集项目的数据清洗工作
☆70Oct 17, 2025Updated 10 months ago
Alternatives and similar repositories for charset_mnbvc
Users that are interested in charset_mnbvc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 文本去重☆76May 23, 2024Updated 2 years ago
- this repo is mnbvc text quality classification using fastText☆16Oct 2, 2023Updated 2 years ago
- MNBVC项目-ShareGPT语料清洗☆16Oct 4, 2023Updated 2 years ago
- Feature Decay Algorithms☆11Mar 5, 2014Updated 12 years ago
- 本项目主要对开源的MOSS SFT数据进行整理 ，转换成mnbvc多轮对话格式。MOSS-003涵盖用性、忠实性、无害性三个层面，共353w样本，MOSS-003 包含更细粒度的有用性类别标记、更广泛的无害性数据和更长对话轮数，共630w样本，☆13Dec 3, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆34Feb 9, 2025Updated last year
- ☆19May 11, 2024Updated 2 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆69Jul 20, 2023Updated 3 years ago
- Transformer related optimization, including BERT, GPT☆39Feb 10, 2023Updated 3 years ago
- Implementing BERT + CRF with PyTorch for Chinese NER.☆10Mar 7, 2022Updated 4 years ago
- Python implementation of AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, w…☆50Mar 22, 2025Updated last year
- A more efficient GLM implementation!☆54Feb 18, 2023Updated 3 years ago
- 把教育信息化体系中的Word试题，Excel试卷、知识点等数据解析成json内容。☆14Mar 3, 2020Updated 6 years ago
- 大模型预训练中文语料清洗及质量评估 Large model pre-training corpus cleaning☆80Jul 25, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 更纯粹、更高压缩率的Tokenizer☆490Nov 27, 2024Updated last year
- [DAC2024] Explainable Fuzzy Neural Network with Multi-Fidelity Reinforcement Learning for Micro-Architecture Design Space Exploration☆10Jul 21, 2026Updated last month
- A library to visualize algorithm by tracing your code.☆11May 31, 2026Updated 2 months ago
- [EMNLP 2023] Official implementation of the algorithm ETSC: Exact Toeplitz-to-SSM Conversion our EMNLP 2023 paper - Accelerating Toeplitz…☆14Oct 17, 2023Updated 2 years ago
- The official repository for Trust-Region Adaptive Policy Optimization (TRAPO) – a novel hybrid framework designed to enhance large langua…☆16Mar 2, 2026Updated 5 months ago
- realize the reinforcement learning training for gpt2 llama bloom and so on llm model☆27Sep 19, 2023Updated 2 years ago
- Gradient accumulation on tf.estimator☆12Dec 15, 2020Updated 5 years ago
- Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…☆53Jul 6, 2023Updated 3 years ago
- Script from the paper generating encrypted network. Dataset☆12Sep 1, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- (ICLR 2025) AgentRefine: Enhancing Agent Generalization through Refinement Tuning☆20Nov 22, 2025Updated 9 months ago
- ☆18Sep 9, 2017Updated 8 years ago
- A lightweight script for processing HTML page to markdown format with support for code blocks☆81Apr 14, 2024Updated 2 years ago
- ☆13Jan 20, 2023Updated 3 years ago
- Implementation of IMvGCN in our paper: Interpretable Graph Convolutional Network for Multi-view Semi-supervised Learning, IEEE TMM.☆11Mar 25, 2024Updated 2 years ago
- Ecg experiment, including Fourier transform, wavelet transform, wavelet decomposition and LSTM feature extraction. Emotion classification…☆11Jul 17, 2020Updated 6 years ago
- Large-Scale High-quality Chinese Web Text with Multi-dimensional and fine-grained information☆41Dec 2, 2024Updated last year
- In this work, we present a novel approach that combines the power of Koopman operators and deep neural networks to generate a linear rep…☆13Dec 1, 2025Updated 8 months ago
- ☆15Sep 24, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- End-to-End Chinese Speaker Identification☆11Nov 17, 2022Updated 3 years ago
- [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios☆71Aug 5, 2025Updated last year
- All-in-one text de-duplication☆765Mar 9, 2026Updated 5 months ago
- ☆70Jun 28, 2022Updated 4 years ago
- A Python implementation of improved Label Propagation Algorithm.☆11May 26, 2021Updated 5 years ago
- Saito --> NEW REPOSITORY -->☆13Jul 27, 2026Updated last month
- 主要是用python进行生存分析的步骤，包括生存分析(逐步和单因素)，KM曲线、决策曲线，ROC曲线，训练测试样本分布比较☆11Dec 21, 2020Updated 5 years ago