KanHatakeyama/JapaneseWarcParser external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

KanHatakeyama/JapaneseWarcParser

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/KanHatakeyama/JapaneseWarcParser)

Close

KanHatakeyama / JapaneseWarcParserView on GitHubMore

• External links
• Readme badge

☆16Mar 4, 2024Updated 2 years ago

Alternatives and similar repositories for JapaneseWarcParser

Users that are interested in JapaneseWarcParser are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• ce-lery / japanese-mistral-300m-recipe

  View on GitHub
  ☆19Mar 12, 2026Updated 5 months ago
• kunishou / do-not-answer-ja

  View on GitHub
  ☆24Dec 15, 2023Updated 2 years ago
• matsuolab / ucllm_nedo_prod

  View on GitHub
  ☆56Jun 17, 2024Updated 2 years ago
• iwiwi / epochraft-hf-fsdp

  View on GitHub
  Example of using Epochraft to train HuggingFace transformers models with PyTorch FSDP
  ☆11Jan 29, 2024Updated 2 years ago
• offtoung / ez-chat-llm

  View on GitHub
  Webブラウザから手軽にローカルLLMとおしゃべりできるソフトウェアです。
  ☆27Dec 28, 2023Updated 2 years ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• yuzu-ai / japanese-llm-ranking

  View on GitHub
  ☆50Apr 10, 2024Updated 2 years ago
• lighttransport / japanese-llama-experiment

  View on GitHub
  Japanese LLaMa experiment
  ☆54Dec 27, 2025Updated 7 months ago
• nu-dialogue / real-persona-chat

  View on GitHub
  RealPersonaChat: A Realistic Persona Chat Corpus with Interlocutors' Own Personalities
  ☆67Mar 13, 2024Updated 2 years ago
• HojiChar / HojiChar

  View on GitHub
  The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.
  ☆128Aug 5, 2026Updated last week
• Sunwood-ai-labs / zoltraak_docker

  View on GitHub
  ☆30Aug 20, 2024Updated last year
• tanakh / super-sabicom

  View on GitHub
  ☆25Aug 31, 2022Updated 3 years ago
• wwwcojp / ja_sentence_segmenter

  View on GitHub
  japanese sentence segmentation library for python
  ☆76Updated this week
• megagonlabs / instruction_ja

  View on GitHub
  Japanese instruction data (日本語指示データ)
  ☆24Jul 13, 2023Updated 3 years ago
• kotoba-tech / kotoba-recipes

  View on GitHub
  Support Continual pre-training & Instruction Tuning forked from llama-recipes
  ☆34Feb 17, 2024Updated 2 years ago
• AI Agents on DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• neodyland / entropix

  View on GitHub
  Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral
  ☆17Jan 12, 2025Updated last year
• johnknash2025 / stanford_alpaca

  View on GitHub
  Code and documentation to train Stanford's Alpaca models, and generate the data.
  ☆24Mar 19, 2023Updated 3 years ago
• SII-sc22mc / DocFusion

  View on GitHub
  A Unified Framework for Document Parsing Tasks (Including Document Layout Analysis, OCR, Formula Recognition, and Table Recognition)
  ☆15Jul 1, 2025Updated last year
• mayu-ot / oc-cost

  View on GitHub
  ☆30Sep 12, 2022Updated 3 years ago
• hppRC / bert-classification-tutorial-2024

  View on GitHub
  【2024年版】BERTによるテキスト分類
  ☆30Jul 8, 2024Updated 2 years ago
• masanorihirano / llm-japanese-dataset

  View on GitHub
  LLM構築用の日本語チャットデータセット
  ☆88Jan 23, 2024Updated 2 years ago
• MorenoLaQuatra / bart-it

  View on GitHub
  Pre-training BART model for the Italian Language
  ☆16Dec 28, 2022Updated 3 years ago
• hikalium / lifestyle_guide

  View on GitHub
  hikalium's lifestyle guide
  ☆14Feb 16, 2025Updated last year
• pecorarista / sakuratheme

  View on GitHub
  A beamer template mainly for Japanese.
  ☆14Apr 21, 2024Updated 2 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• auto-res / lean-rademacher

  View on GitHub
  Lean Formalization of Generalization Error Bound by Rademacher Complexity
  ☆22Jul 24, 2026Updated 3 weeks ago
• leia-llm / leia

  View on GitHub
  LEIA: Facilitating Cross-Lingual Knowledge Transfer in Language Models with Entity-based Data Augmentation
  ☆23Apr 24, 2024Updated 2 years ago
• nlp-waseda / JMMLU

  View on GitHub
  日本語マルチタスク言語理解ベンチマーク Japanese Massive Multitask Language Understanding Benchmark
  ☆41Oct 7, 2025Updated 10 months ago
• Hayata-Yamasaki-Group / lean-quantum

  View on GitHub
  Lean formalization of the theory of quantum information and quantum computation
  ☆28Jul 20, 2026Updated 3 weeks ago
• uma-arai / iac-story-code

  View on GitHub
  ☆10Dec 29, 2022Updated 3 years ago
• python-nlp-book / python-nlp-book

  View on GitHub
  ディープラーニングによる自然言語処理（共立出版）のサポートページです
  ☆10May 7, 2023Updated 3 years ago
• nu-dialogue / jmultiwoz

  View on GitHub
  JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset, LREC-COLING 2024
  ☆25Mar 27, 2024Updated 2 years ago
• swallow-llm / swallow-evaluation

  View on GitHub
  Swallowプロジェクト 大規模言語モデル 評価スクリプト
  ☆25Sep 17, 2025Updated 10 months ago
• mizuumi / JDocQA

  View on GitHub
  ☆44Apr 10, 2025Updated last year
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• kiliman / remix-suspense

  View on GitHub
  Remix example showing how to ensure the Suspense fallback is rendered on route change
  ☆10Mar 15, 2024Updated 2 years ago
• fujiwara / isucon11-f

  View on GitHub
  ☆13Sep 18, 2021Updated 4 years ago
• textlint-ja / textlint-rule-ja-no-inappropriate-words

  View on GitHub
  不適切表現をチェックするtextlintルール
  ☆13Jan 7, 2023Updated 3 years ago
• Code-for-SAKE / Sakepedia-Nuxt

  View on GitHub
  日本酒オープンデータSakepediaのNuxt版
  ☆22Jun 17, 2023Updated 3 years ago
• Hajime-Y / BitNet-b158

  View on GitHub
  ☆20Apr 29, 2024Updated 2 years ago
• Takeuchi-Lab-LM / python_asa

  View on GitHub
  python版日本語意味役割付与システム（ASA）
  ☆22Nov 11, 2022Updated 3 years ago
• NovelAI / novelai-tokenizer

  View on GitHub
  Sentencepiece based BPE tokenizer for English and Japanese language text.
  ☆29Apr 4, 2024Updated 2 years ago