{"id":3140,"date":"2026-11-16T12:06:48","date_gmt":"2026-11-16T05:06:48","guid":{"rendered":"https:\/\/research.binus.ac.id\/airdc\/?p=3140"},"modified":"2026-11-16T12:06:48","modified_gmt":"2026-11-16T05:06:48","slug":"robustness-of-sensitive-data-detection-against-indonesian-noisy-text-in-shadow-ai","status":"publish","type":"post","link":"https:\/\/research.binus.ac.id\/airdc\/2026\/11\/robustness-of-sensitive-data-detection-against-indonesian-noisy-text-in-shadow-ai\/","title":{"rendered":"Robustness of Sensitive Data Detection Against Indonesian Noisy Text in Shadow AI"},"content":{"rendered":"<p>This study evaluates the trade-off between deterministic pattern-matching, fine-tuned discriminative, and reasoning paradigms for sensitive data detection across noisy Indonesian text. The evaluation processes five distinct entity types across formal, code-mixed, and slang registers using 1,500 stratified prompts, with statistical validation conducted via paired permutation tests. The reasoning paradigm achieves the highest mean F1-scores for NIK at 0.928 and credit cards at 0.948, with recall degradation of only 0.094, showing strong robustness. The fine-tuned discriminative model leads in bank accounts at 0.949 and emails at 1.000 but proves highly fragile to informal register shifts. Pattern-matching leads in phone numbers at 0.952 but records zero credit card recall. A stark efficiency contrast emerges as pattern-matching reaches 21692.2 tokens per second on local CPU hardware, whereas the discriminative model delivers a 1099.8 speedup over the reasoning paradigm on an NVIDIA A100 GPU architecture, which suffers a heavy mean latency penalty of 13247.369 ms. These structural trade-offs support a layered data loss prevention framework combining deterministic filtering with contextual inference to optimize throughput and accuracy.<\/p>\n<p>Authors:<br \/>\nGrace Esther Simanjuntak, Kuncahyo Setyo Nugroho, Mahmud Isnan, and Bens Pardamean.<\/p>\n<p><em>The 13th International Conference on ICT for Smart Society (ICISS) 2026<\/p>\n<p><\/em><a href=\"https:\/\/www.researchgate.net\/publication\/413599771_Robustness_of_Sensitive_Data_Detection_Against_Indonesian_Noisy_Text_in_Shadow_AI\"><span style=\"text-decoration: underline\">Read Full Text<\/span><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This study evaluates the trade-off between deterministic pattern-matching, fine-tuned discriminative, and reasoning paradigms for sensitive data detection across noisy Indonesian text. The evaluation processes five distinct entity types across formal, code-mixed, and slang registers using 1,500 stratified prompts, with statistical validation conducted via paired permutation tests. The reasoning paradigm achieves the highest mean F1-scores for [&hellip;]<\/p>\n","protected":false},"author":14,"featured_media":3141,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16],"tags":[],"class_list":["post-3140","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-publications"],"_links":{"self":[{"href":"https:\/\/research.binus.ac.id\/airdc\/wp-json\/wp\/v2\/posts\/3140","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/research.binus.ac.id\/airdc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/research.binus.ac.id\/airdc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/research.binus.ac.id\/airdc\/wp-json\/wp\/v2\/users\/14"}],"replies":[{"embeddable":true,"href":"https:\/\/research.binus.ac.id\/airdc\/wp-json\/wp\/v2\/comments?post=3140"}],"version-history":[{"count":1,"href":"https:\/\/research.binus.ac.id\/airdc\/wp-json\/wp\/v2\/posts\/3140\/revisions"}],"predecessor-version":[{"id":3142,"href":"https:\/\/research.binus.ac.id\/airdc\/wp-json\/wp\/v2\/posts\/3140\/revisions\/3142"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/research.binus.ac.id\/airdc\/wp-json\/wp\/v2\/media\/3141"}],"wp:attachment":[{"href":"https:\/\/research.binus.ac.id\/airdc\/wp-json\/wp\/v2\/media?parent=3140"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/research.binus.ac.id\/airdc\/wp-json\/wp\/v2\/categories?post=3140"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/research.binus.ac.id\/airdc\/wp-json\/wp\/v2\/tags?post=3140"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}