People Innovation Excellence
 

Preprocessing Methods and Tools in Modelling Japanese for Text Classification

Reza Rahutomo, Febrian Lubis, Hery Harjono Muljo, Bens Pardamean

Conference: International Conference on Information Management and Technology 2019, Bali, Indonesia

Abstract: As a subset of Artificial Intelligence, Natural Language Processing (NLP) is a breakthrough in surpassing language barrier. Japanese language characteristics bring its own challenge in morphological analysis due to the uniqueness of Japanese grammatical system. By the rapid development of NLP tools, many Japanese NLP tools developed with limited ability yet specialized in running certain preprocessing methods. In this paper, the compilation of various methods and newly discovered tools for preprocess Japanese text are delivered to help people decide which Japanese NLP tools needs to be utilized to run some preprocessing methods. All of the Japanese preprocessing methods and tools are collected through literature review. It is concluded that depending on one NLP tool is not recommended since combination of Japanese NLP tools is required to finish Japanese preprocessing phase.

Read more


Published at : Updated

Periksa Browser Anda

Check Your Browser

Situs ini tidak lagi mendukung penggunaan browser dengan teknologi tertinggal.

Apabila Anda melihat pesan ini, berarti Anda masih menggunakan browser Internet Explorer seri 8 / 7 / 6 / ...

Sebagai informasi, browser yang anda gunakan ini tidaklah aman dan tidak dapat menampilkan teknologi CSS terakhir yang dapat membuat sebuah situs tampil lebih baik. Bahkan Microsoft sebagai pembuatnya, telah merekomendasikan agar menggunakan browser yang lebih modern.

Untuk tampilan yang lebih baik, gunakan salah satu browser berikut. Download dan Install, seluruhnya gratis untuk digunakan.

We're Moving Forward.

This Site Is No Longer Supporting Out-of Date Browser.

If you are viewing this message, it means that you are currently using Internet Explorer 8 / 7 / 6 / below to access this site. FYI, it is unsafe and unable to render the latest CSS improvements. Even Microsoft, its creator, wants you to install more modern browser.

Best viewed with one of these browser instead. It is totally free.

  1. Google Chrome
  2. Mozilla Firefox
  3. Opera
  4. Internet Explorer 9
Close