A very fast japanese segmenter, inspired by the Hakurei Shrine maiden Reimu Hakurei, a central character in the Touhou series.
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
2025-05-27 01:13:34 +00:00
misc new appearance 2024-11-10 22:10:35 -04:00
res add art 2024-05-11 18:41:22 -04:00
src fix padding 2024-11-10 22:05:12 -04:00
LICENSE.txt Update LICENSE.txt 2024-05-11 17:33:25 -04:00
README.md Update README.md 2025-05-27 01:13:34 +00:00

🌸 Hakurei 🌸

Welcome to Hakurei, the ultimate Japanese tokenizer powered by cutting-edge technology! Whether you're crafting your next-gen anime subtitle processor, building an amazing manga reader, or just need a super-fast tokenizer, Hakurei has got you covered with unparalleled speed and accuracy. 🎌✨

cover usage

Table of Contents

Features

  • 🚀 Blazing Fast: Harness the speed of the gods with our state-of-the-art algorithms.
  • 🎯 Ultra Accurate: Slice through Japanese text with ninja-like precision.
  • 🔧 Easy Integration: Plug and play with our CLI, perfect for all your projects.
  • 💪 Super Robust: Handle massive datasets like a mecha warrior!

Installation

Installing Hakurei is a breeze!:

  • install xcdat
    then copy the dictionary from the res and it should be placed like this:
hashirama@lisp-machine ~$ ls .local/share/hakurei/
dict.bin

finally:

$ g++ src/hakurei.cpp -o hakurei 

the binary can be placed in /bin or any other place in the $PATH

in goldendict-ng :
External programs can be added by opening Preferences (F4) and going to "Sources" > "Programs".

/home/hashirama/.local/bin/hakurei  --goldendict --word %GDWORD% --sentence %GDSEARCH%