This Tibetan tokenizer based on Bi-LSTM+CRF methods, it was created with the aim of aiding researchers in the field of Tibetan natural language processing.
☆11Dec 16, 2025Updated 10 months ago
Alternatives and similar repositories for -Tibetan-tokenizer-
Users that are interested in -Tibetan-tokenizer- are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 基于LLAMA2的增量预训练藏文大语言模型Tibetan-LLAMA2-7B&Tibetan-LLAMA2-13B；指令微调藏文大模型Tibetan-Alpaca-7B&Tibetan-Alpaca-13B。☆48Jun 8, 2024Updated 2 years ago
- 😎 Curated list of Tibetan NLP projects☆47Jul 15, 2020Updated 6 years ago
- 🏷 བོད་ཏོག [pʰøtɔk̚] Tibetan word tokenizer in Python☆82Jul 22, 2026Updated 2 months ago
- Lucene analyzer for Tibetan☆13Oct 23, 2025Updated 11 months ago
- ☆19Oct 8, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 基于LLaMA2-7B增量预训练的藏文大语言模型TiLamb（Tibetan Large Language Model Base）☆37Apr 3, 2024Updated 2 years ago
- A Multi-tasking and Multi-stage Chinese Minority Pre-Trained Language Model☆12Jul 24, 2023Updated 3 years ago
- MNIST of Tibetan handwriting 国产手写藏文MNIST数据集（TibetanMNIST）的图像分类处理与各种好玩的脑洞~☆37Feb 2, 2019Updated 7 years ago
- ☆16Mar 25, 2025Updated last year
- Code for EMNLP 2023 paper: DALE: Generative Data Augmentation for Low-Resource Legal NLP☆11Oct 27, 2023Updated 2 years ago
- ☆19Jun 20, 2017Updated 9 years ago
- Hunspell files for Tibetan☆24Aug 5, 2015Updated 11 years ago
- SpringVue全栈学习配套代码·纯手搓·非全部☆16Jan 16, 2024Updated 2 years ago
- Cross-lingual Visual Pre-training for Multimodal Machine Translation☆18Dec 28, 2021Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- TIP-LAS: An open source toolkit for Tibetan word segmentation and part-of-speech tagging☆86Nov 11, 2022Updated 3 years ago
- repo for Tibetan corpora☆26Apr 10, 2023Updated 3 years ago
- 针对教师教学质量管理的系统，包括评价教师、课表查看、日志检索等功能，使用Spring Security做权限控制，根据用户角色动态渲染导航页面。☆13Mar 19, 2024Updated 2 years ago
- Dense Article Dataset (DAD): A Benchmark Dataset for Document Layout Analysis☆16Jan 13, 2022Updated 4 years ago
- BERT baselines for extractive question answering on coqa (https://stanfordnlp.github.io/coqa/)☆10Jan 27, 2020Updated 6 years ago
- Public repository of open access Tibetan fonts☆37Sep 8, 2026Updated last month
- 使用transformer构建的机器翻译系统☆10Jun 16, 2023Updated 3 years ago
- ☆10Sep 9, 2024Updated 2 years ago
- ✒️ དག་བྱེད། Dakje, improving your spelling and readability☆12Jul 19, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Viterbi part-of-speech tagger, trained on Wall Street Journal (WSJ) data☆14Mar 6, 2018Updated 8 years ago
- 格物-多语言和中文大规模预训练模型-轻量版，涵盖纯中文、知识增强、113个语种多语言，采用主流Roberta架构，适用于NLU和NLG任务， 支持pytorch、tensorflow、uer、huggingface等框架。 Multilingual and Chinese …☆30Nov 17, 2022Updated 3 years ago
- A TensorFlow implementation of FlowQA☆15Nov 24, 2018Updated 7 years ago
- a corpus containing 4.5K conversations from the Conversational Question-Answering dataset CoQA, for a total of 53K follow-up question-ans…☆16Jun 12, 2023Updated 3 years ago
- 🦜 NLP for Tibetan, in Python.☆43Apr 2, 2026Updated 6 months ago
- CINO: Pre-trained Language Models for Chinese Minority (少数民族语言预训练模型)☆272Jul 15, 2025Updated last year
- a simple implementation of part-of-speech tagging with hmm☆13Feb 26, 2019Updated 7 years ago
- BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages☆227Nov 21, 2023Updated 2 years ago
- 😎 Curated list of tibetan canon datasets☆20Apr 6, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆14Jul 27, 2022Updated 4 years ago
- Repository to use/train segmentation models for document layout analysis☆19Jan 13, 2022Updated 4 years ago
- Machine Reading Comprehension (MRC)☆19Mar 24, 2020Updated 6 years ago
- Albert for Conversational Question Answering Challenge☆21Jun 12, 2023Updated 3 years ago
- 基于ChatGPT的问答对自动生成，可复用于其他NLP领域☆20Apr 3, 2023Updated 3 years ago
- use for DL,LINUX,C++,PYTHON,MATLAB and so on☆30Feb 4, 2023Updated 3 years ago
- Text selection, grouping, and manipulation in Swift☆14Sep 21, 2026Updated last month