ANALISIS KESALAHAN TERJEMAHAN ARTIFICIAL INTELLIGENCE PADA TEKS BISNIS JEPANG-INDONESIA MENGGUNAKAN PENDEKATAN TRANSLATION QUALITY ASSESSMENT BERBASIS MULTIDIMENSIONAL QUALITY METRICS (MQM)
Keywords
Artificial Intelligence, Machine Translation, Japanese Business Language, Keigo, Multidimensional Quality MetricsAbstract
The advancement of Artificial Intelligence (AI) technology has increased the use of automatic translation systems in cross-language communication, including Japanese-Indonesian business translation. The characteristics of Japanese business language, which involve honorific expressions (keigo), indirect communication, professional terminology, and cultural conventions, remain challenging for AI-based translation systems. This study aims to identify the types of AI translation errors, classify them using a Translation Quality Assessment (TQA) approach based on Multidimensional Quality Metrics (MQM), and analyze the factors contributing to these errors. This research employed a descriptive qualitative method using translation error analysis. The corpus consisted of 50 Japanese business texts translated into Indonesian using three AI translation systems-Google Translate, DeepL, and ChatGPT-resulting in 150 translation units. The data were analyzed using six MQM categories: Accuracy, Terminology, Fluency, Grammar, Style, and Locale Convention. The findings revealed 90 translation errors among the 150 units analyzed. The dominant error category was Style/Keigo, with 45 cases (50%), followed by Accuracy with 23 cases (25.5%), Fluency with 9 cases (10%), Locale Convention with 8 cases (8.9%), and Terminology with 5 cases (5.6%), while the Grammar category showed no significant errors. These findings indicate that although AI translation systems demonstrate strong linguistic and grammatical capability, they continue to face challenges in interpreting pragmatic meaning, politeness levels, and the cultural values embedded in Japanese business communication
References
[1] Bahdanau, D., Cho, K., & Bengio, Y. (2015). Neural machine translation by jointly learning to align and translate. International Conference on Learning Representations.
[2] Brown, P., & Levinson, S. C. (1987). Politeness: Some universals in language usage. Cambridge University Press.
[3] Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901.
[4] Castilho, S., Moorkens, J., Gaspari, F., Calixto, I., Tinsley, J., & Way, A. (2017). Is neural machine translation the new state of the art? The Prague Bulletin of Mathematical Linguistics, 108, 109–120. https://doi.org/10.1515/pralin-2017-0013
[5] Fukada, A., & Asato, N. (2004). Universal politeness theory: Application to the use of Japanese honorifics. Journal of Pragmatics, 36(11), 1991–2002. https://doi.org/10.1016/j.pragma.2003.11.006
[6] House, J. (2015). Translation quality assessment: Past and present. Routledge.
[7] Ide, S. (1989). Formal forms and discernment: Two neglected aspects of linguistic politeness. Multilingua, 8(2–3), 223–248. https://doi.org/10.1515/mult.1989.8.2-3.223
[8] Jiao, W., Wang, W., Huang, J., Wang, X., Shi, S., & Tu, Z. (2023). Is ChatGPT a good translator? A preliminary study. arXiv. https://doi.org/10.48550/arXiv.2301.08745
[9] Koehn, P. (2020). Neural machine translation. Cambridge University Press.
[10] Lommel, A., Burchardt, A., & Uszkoreit, H. (2014). Multidimensional Quality Metrics: A framework for declaring translation quality metrics. Tradumàtica, 12, 455–463. https://doi.org/10.5565/rev/tradumatica.77
[11] Matsumoto, S., Sakuma, Y., Nagatomo, E., Nanba, F., Matsukura, A., & Hamahata, Y. (2018). Writing business emails in Japanese: The basics and practical examples. The Japan Times.
[12] Nababan, M., Nuraeni, A., & Sumardiono. (2012). Pengembangan model penilaian kualitas terjemahan. Kajian Linguistik dan Sastra, 24(1), 39–57.
[13] Nida, E. A., & Taber, C. R. (1982). The theory and practice of translation. Brill.
[14] Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30, 5998–6008.
