The Mediating Effect of AI Application in the Relationship between AI Awareness and AI Trust
Article Sidebar
Main Article Content
Abstract
In education, AI awareness is crucial in building trust and effective application of AI technologies among users. By understanding AI’s capabilities and limitations, learners can develop a more informed trust in AI systems, enhancing their ability to apply AI effectively in practical scenarios. This study investigates how AI applications influence the relationship between AI awareness and trust among university students in the Philippines' Regions XI and XII. The study used a quantitative, non-experimental correlational method, with 1161 university L2 learners chosen by stratified random selection. Data was gathered by online surveys with questions scored on a 5-point Likert scale, as revealed by Ng et al. (2022) and Wang et al. (2023). SmartPLS version 4.0 was used for bootstrapping mediation analysis, while Jamovi 2.0 was used for statistical analysis of descriptive data. The findings revealed significant relationships between AI awareness and AI application (coefficients ranging from 0.831 to 0.875) and AI application and AI trust (coefficient = 0.329). The mediation study revealed a substantial indirect influence of AI awareness on AI trust through AI application (coefficient = 0.167), emphasizing the potential of experiential learning-based training strategies to improve AI competency and trust. These findings give useful insights for building AI educational programs that increase student acceptance and trust in AI technology.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Ameen, N., Tarhini, A., Reppel, A., & Anand, A. (2021). Customer experiences in the age of artificial intelligence. Computers in Human Behavior, 114, 106548.https://doi.org/10.1016/j.chb.2020.106548
Asio, J. M. R., & Suero, A. N. (2024). Artificial Intelligence Anxiety, Self-Efficacy, and Self-Competence among Students: Implications to Higher Education Institutions. Education Policy and Development, 2(2), 82–93. https://doi.org/10.31098/epd.v2i2.2541
Bedué, P., & Fritzsche, A. (2021). Can we trust AI? An empirical investigation of trust requirements and guide to successful AI adoption. Journal of Enterprise Information Management, 35(2), 530–549. https://doi.org/10.1108/jeim-06-2020-0233
Bobby L. Asirit, L., & H. Hua, J. (2023). Converging perspectives: Assessing AI readiness and utilization in Philippine higher education. Polaris Global Journal of Scholarly Research and Trends, 2(3), 1–50. https://doi.org/10.58429/pgjsrt.v2n3a152
Burgoon, J. K. (1993). Interpersonal Expectations, Expectancy Violations, and Emotional Communication. Journal of Language and Social Psychology, 12(1-2), 30–48. https://doi.org/10.1177/0261927x93121003
Concepcion, R. S., Bedruz, R. A. R., Culaba, A. B., Dadios, E. P., & Pascua, A. R. A. R. (2019). The technology adoption and governance of artificial intelligence in the Philippines. 2019 IEEE 11th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management (HNICEM), 1–10. https://doi.org/10.1109/HNICEM48295.2019.9072725
Cheung, G.W., Cooper-Thomas, H.D., Lau, R.S. et al. Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations. Asia Pac J Manag 41, 745–783 (2024). https://doi.org/10.1007/s10490-023-09871-y
Choung, H., David, P., & Ross, A. (2022). Trust in AI and Its Role in the Acceptance of AI Technologies. International Journal of Human-Computer Interaction, 39(9), 1727–1739. https://doi.org/10.1080/10447318.2022.2050543
Creswell, J. W., & Creswell, J. D. (2023). Research design: “Qualitative, Quantitative, and Mixed Methods
Approaches” (6th ed.). SAGE Publications
Davis, F. D., & Granić, A. (2024). The technology acceptance model. In Human-computer interaction series. Springer Nature. https://doi.org/10.1007/978-3-030-45274-2
Dorton, S. L., & Harper, S. B. (2022). A Naturalistic Investigation of Trust, AI, and Intelligence Work. Journal of Cognitive Engineering and Decision Making, 16(4), 222–236. https://doi.org/10.1177/15553434221103718
Gillath, O., Ai, T., Branicky, M. S., Keshmiri, S., Davison, R. B., & Spaulding, R. (2021). Attachment and trust in artificial intelligence. Computers in Human Behavior, 115, 106607. https://doi.org/10.1016/j.chb.2020.106607
Hair, J.F., Hult, G.T.M., Ringle, C.M., Sarstedt, M., Danks, N.P., Ray, S. (2021). Evaluation of Reflective Measurement Models. In: Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R. Classroom Companion: Business. Springer, Cham. https://doi.org/10.1007/978-3-030-80519-7_4
Hohenstein, J., & Jung, M. (2019). AI as a moral crumple zone: The effects of AI-mediated communication on attribution and trust. Computers in Human Behavior, 106, 106190. https://doi.org/10.1016/j.chb.2019.106190
Hovsepyan, T. (2024).Transparency AI: Defining, Implementing, and Advancing Ethical Practices. Transparency AI: The Path to Ethical and Trustworthy Technology (plat.ai)
Jermutus, E., Kneale, D., Thomas, J., & Michie, S. (2022). Influences on User Trust in Healthcare Artificial Intelligence: A Systematic Review. Wellcome Open Research, 7, 65. https://doi.org/10.12688/wellcomeopenres.17550.1
Kaplan, A. D., Kessler, T. T., Brill, J. C., & Hancock, P. A. (2021). Trust in Artificial Intelligence: Meta-Analytic Findings. Human Factors: The Journal of the Human Factors and Ergonomics Society, 65(2), 001872082110139. https://doi.org/10.1177/00187208211013988
Kasinidou, M., Styliani Kleanthous, Busso, M., Rodas, M., Otterbacher, J., & Giunchiglia, F. (2024). Artificial Intelligence in Everyday Life 2.0: Educating University Students from Different Majors. ArXiv (Cornell University). https://doi.org/10.1145/3649217.3653542
Lee, J. D., & See, K. A. (2004). Trust in Automation: Designing for Appropriate Reliance. Human Factors: The Journal of the Human Factors and Ergonomics Society, 46(1), 50–80. https://doi.org/10.1518/hfes.46.1.50_30392
MacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007). Mediation analysis. Annual Review of Psychology, 58(1), 593–614. https://doi.org/10.1146/annurev.psych.58.110405.085542
Ng, D. T. K., Leung, J. K. L., Su, J., Ng, R. C. W., & Chu, S. K. W. (2023). Teachers’ AI digital competencies and twenty-first century skills in the post-pandemic world. Educational Technology Research and Development, 71(1). https://doi.org/10.1007/s11423-023-10203-6
Obenza, B. N., Caballo, J. H. S., Caangay, R. B. R., Makigod, T. E. C., Almocera, S. M., Bayno, J. L. M., Camposano, J. J. R., Cena, S. J. G., Garcia, J. A. K., Labajo, B. F. M., & Tua, A. G. (2024). Analyzing University Students’ Attitude and Behavior Toward AI Using the Extended Unified Theory of Acceptance and Use of Technology Model. American Journal of Applied Statistics and Economics, 3(1), 99–108. https://doi.org/10.54536/ajase.v3i1.2510
Obenza, B., Baguio, J. S. I., Bardago, K. M., Granado, L., Loreco, K. C., Matugas, L., Talaboc, D. J., Zayas, R. K. D., Caballo, J. H., & Caangay, R. B. (2024, February 14). The Mediating Effect of AI Trust on AI Self-Efficacy and Attitude Toward AI of College Students. Social Science Research Network. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4726221
Obenza, Brandon and Salvahan, Alexa and Rios, Alexandra Nicole and Solo, Althea and Alburo, Rea Ashlee and Gabila, Rey Jose, University Students' Perception and Use of ChatGPT: Generative Artificial Intelligence (AI) in Higher Education (February 13, 2024). International Journal of Human Computing Studies, 5(12), 5-18, 2024, Available at SSRN: https://ssrn.com/abstract=4724968
Obenza, B. N., Go, L. E., Francisco, J. A. M., Buit, E. E. T., Mariano, F. V. B., Cuizon Jr, H. L., Cagabhion, A. J. D., & Agbulos, K. A. J. L. (2024). The Nexus between Cognitive Absorption and AI Literacy of College Students as Moderated by Sex. American Journal of Smart Technology and Solutions, 3(1), 32–39. https://doi.org/10.54536/ajsts.v3i1.2603
Schaub, J. A., Hamidi, H., Subramanian, L., & Kretzler, M. (2020). Systems Biology and Kidney Disease. 15(5), 695–703. https://doi.org/10.2215/cjn.09990819
Sethumadhavan, A. (2018). Trust in artificial intelligence. Ergonomics in Design the Quarterly of Human Factors Applications, 27(2), 34. https://doi.org/10.1177/1064804618818592
Shahzad, M.F., Xu, S. & Javed, I. (2024). ChatGPT awareness, acceptance, and adoption in higher education: the role of trust as a cornerstone. Int J Educ Technol High Educ 21, 46 https://doi.org/10.1186/s41239-024-00478-x
Troshani, I., Hill, S. R., Sherman, C., & Arthur, D. (2020). Do We Trust in AI? Role of Anthropomorphism and Intelligence. Journal of Computer Information Systems, 61(5), 481–491. https://doi.org/10.1080/08874417.2020.1788473
Tsai, W.-J., & Yao, S.-H. (2023). Effects of Adventure Education with Digital Teaching on Students’ Self-Efficacy and Interpersonal Relationship. International Journal of Emerging Technologies in Learning (IJET), 18(22), 128–137. https://www.learntechlib.org/p/223740/
Turner, M., Kitchenham, B., Brereton, P., Charters, S., & Budgen, D. (2010). Does the technology acceptance model predict actual use? A systematic literature review. Information and Software Technology, 52(5), 463–479. https://doi.org/10.1016/j.infsof.2009.11.005
Walter, Y. Embracing the future of Artificial Intelligence in the classroom: the relevance of AI literacy, prompt engineering, and critical thinking in modern education. Int J Educ Technol High Educ 21, 15 (2024). https://doi.org/10.1186/s41239-024-00448-3
Wang, C., Wang, H., Li, Y., Dai, J., Gu, X., & Yu, T. (2024). Factors Influencing University Students’ Behavioral Intention to Use Generative Artificial Intelligence: Integrating the Theory of Planned Behavior and AI Literacy. International Journal of Human-Computer Interaction, 1–23. https://doi.org/10.1080/10447318.2024.2383033
Zhai, C., Wibowo, S. & Li, L.D. The effects of over-reliance on AI dialogue systems on students' cognitive abilities: a systematic review. Smart Learn. Environ. 11, 28 (2024). https://doi.org/10.1186/s40561-024-00316-7
Zhao, L., Wu, X., & Luo, H. (2022). Developing AI Literacy for Primary and Middle School Teachers in
China: Based on a Structural Equation Modeling Analysis. Sustainability, 14(21), 14549. https://doi.org/10.3390/su142114549