Meta Artificial Intelligence Literacy of University Students: A Comparative Analysis
Main Article Content
Abstract
This study aims find the level of meta-artificial intelligence (AI) literacy in male and female students at the University of Mindanao. First, meta AI literacy involves a comprehensive understanding, application, evaluation, and ethical engagement with AI technologies. The study made use of a quantitative, non-experimental correlational design and gathered data from 325 students through a structured online survey. The survey instrument was adapted from Carolus et al. (2023), which assessed various aspects of AI literacy, from knowledge, application, ethics, to self-efficacy. The study used stratified sampling for an equal representation of academic levels and genders. Descriptive statistics, t-tests, and ANOVA were used to compare AI literacy scores of male and female students and to examine the connection between literacy and academic performance. Now, the results revealed that AI literacy levels were moderate for both genders, with small differences between male and female students. Female students scored slightly higher in AI ethics, while male students displayed greater confidence in AI application, but these variances were not statistically significant. The study emphasizes the importance of customized teaching method to enhance AI literacy skills, especially in application, across all student demographics. This research offers valuable insights into AI literacy among university students and presents recommendations for improving AI education within the curriculum.
Article Details

This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Allen, L., & Kendeou, P. (2023). ED-AI Lit: An Interdisciplinary Framework for AI Literacy in Education. Policy Insights from the Behavioral and Brain Sciences. https://doi.org/10.1177/23727322231220339.
Asio, J.M.R. (2024). Artificial Intelligence (AI) Literacy and Academic Performance of Tertiary Level Students: A Preliminary Analysis. Social Sciences, Humanities and Education Journal (SHE Journal), 5(2), 309 – 321.
Carolus, A., Koch, M., Straka, S., Latoschik, M., & Wienrich, C. (2023). MAILS - Meta AI Literacy Scale: Development and Testing of an AI Literacy Questionnaire Based on Well-Founded Competency Models and Psychological Change- and Meta-Competencies. ArXiv, abs/2302.09319. https://doi.org/10.48550/arXiv.2302.09319.
Cetindamar, D., Kitto, K., Wu, M., Zhang, Y., Abedin, B., & Knight, S. (2022). Explicating AI Literacy of Employees at Digital Workplaces. IEEE Transactions on Engineering Management, PP, 1-14. https://doi.org/10.1109/TEM.2021.3138503.
Cotton, D., Cotton, P., & Shipway, J. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International. https://doi.org/10.1080/14703297.2023.2190148.
Creswell, J. W., & Creswell, J. D. (2023). Research design: Qualitative, Quantitative, and Mixed Methods Approaches (6th ed.). SAGE Publications.
Dai, Y., Chai, C., Lin, P., Jong, M., Guo, Y., & Qin, J. (2020). Promoting Students’ Well-Being by Developing Their Readiness for the Artificial Intelligence Age. Sustainability. https://doi.org/10.3390/su12166597.
Dergaa, I., Chamari, K., Żmijewski, P., & Saad, H. (2023). From human writing to artificial intelligence generated text: examining the prospects and potential threats of ChatGPT in academic writing.. Biology of sport, 40 2, 615-622 . https://doi.org/10.5114/biolsport.2023.125623.
Dunn, T. J., Baguley, T., & Bruns, R. (2014). From alpha to omega: A practical solution to the perennial problem of internal consistency estimation. British Journal of Psychology, 105(3), 399-412. https://doi.org/10.1111/bjop.12046
Estrellado, C.J,, & Miranda, J.C. (2023). Artificial Intelligence in the Philippine Educational Context: Circumspection and Future Inquiries. 4. 16. 10.29322/IJSRP.13.04.2023.p13704.
Field, A.P. (2018) Discovering Statistics Using IBM SPSS Statistics. 5th Edition, Sage, Newbury Park.
García-Martínez, I., Fernández-Batanero, J., Fernández-Cerero, J., & León, S. (2023). Analysing the Impact of Artificial Intelligence and Computational Sciences on Student Performance: Systematic Review and Meta-analysis. Journal of New Approaches in Educational Research. https://doi.org/10.7821/naer.2023.1.1240.
Kimiafar, K., Sarbaz, M., Tabatabaei, S., Ghaddaripouri, K., Mousavi, A., Mehneh, M., & Baigi, S. (2023). Artificial Intelligence Literacy Among Healthcare Professionals and Students: A Systematic Review. Frontiers in Health Informatics. https://doi.org/10.30699/fhi.v12i0.524.
Lee, I., Ali, S., Zhang, H., DiPaola, D., & Breazeal, C. (2021). Developing Middle School Students' AI Literacy. Proceedings of the 52nd ACM Technical Symposium on Computer Science Education. https://doi.org/10.1145/3408877.3432513.
Lin, Z. (2023). Why and how to embrace AI such as ChatGPT in your academic life. Royal Society Open Science, 10. https://doi.org/10.1098/rsos.230658.
Long, D., & Magerko, B. (2020). What is AI Literacy? Competencies and Design Considerations. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3313831.3376727.
Long, P. D., & Magerko, B. (2020). Toward a framework for AI literacy. AI & Society, 35(3), 509-518. https://doi.org/10.1007/s00146-020-00986-6
Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education Artificial Intelligence, 2, 100041.https://doi.org/10.1016/j.caeai.2021.100041
Obenza, B. N., Baguio, J. S. I. E., Bardago, K. M. W., Granado, L. B., Loreco, K. C. A., Matugas, L. P., Talaboc, D. J., Zayas, R. K. D. D., Caballo, J. H. S., & Caangay, R. B. R. (2023a). The Mediating Effect of AI Trust on AI Self-Efficacy and Attitude Toward AI of College Students. International Journal of Metaverse, 2(1), 1–10. https://doi.org/10.54536/ijm.v2i1.2286
Obenza, B. N., Salvahan, A., Rios, A. N., Solo, A., Alburo, R. A., & Gabila, R. J. (2023b). University Students’ Perception and Use of ChatGPT: Generative Artificial Intelligence (AI) in Higher Education. International Journal of Human Computing Studies, 5(12), 5-18. https://doi.org/10.31149/ijhcs.v5i12.5033
Obenza, B. N., Go, L. E., Francisco, J. A. M., Buit, E. E. T., Mariano, F. V. B., Cuizon Jr, H. L., Cagabhion, A. J. D., & Agbulos, K. A. J. L. (2024c). The Nexus between Cognitive Absorption and AI Literacy of College Students as Moderated by Sex. American Journal of Smart Technology and Solutions, 3(1), 32–39. https://doi.org/10.54536/ajsts.v3i1.2603
Obenza, B. N., Caballo, J. H. S., Caangay, R. B. R., Makigod, T. E. C., Almocera, S. M., Bayno, J. L. M., Camposano, J. J. R., Cena, S. J. G., Garcia, J. A. K., Labajo, B. F. M., & Tua, A. G. (2024d). Analyzing University Students’ Attitude and Behavior Toward AI Using the Extended Unified Theory of Acceptance and Use of Technology Model. American Journal of Applied Statistics and Economics, 3(1), 99–108. https://doi.org/10.54536/ajase.v3i1.2510Sanabria-Z, J., Castillo-Martínez, I., González-Pérez, L., &
Ramírez-Montoya, M. (2023). Complex thinking through a Transition Design-guided Ideathon: testing an AI platform on the topic of sharing economy. , 8. https://doi.org/10.3389/feduc.2023.1186731.
Sariyasa, S., & Monika, K. (2023). Artificial Intelligence and Academic Ethics in The Era of Merdeka Belajar : How Are Students' Responses?. Jurnal Kependidikan: Jurnal Hasil Penelitian dan Kajian Kepustakaan di Bidang Pendidikan, Pengajaran dan Pembelajaran. https://doi.org/10.33394/jk.v9i3.8720.
Taber, K. S. (2017). The use of Cronbachs Alpha when developing and reporting research instruments in science education. Research in Science Education, 48(6), 12731296. Https://doi.org/10.1007/s11165-016-9602-2.
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53-55. https://doi.org/10.5116/ijme.4dfb.8dfd
Yang, Y., & Xia, N. (2023). Enhancing Students' Metacognition via AI-Driven Educational Support Systems. International Journal of Emerging Technologies in Learning (iJET). https://doi.org/10.3991/ijet.v18i24.45647.
Yau, K., Chai, C., Chiu, T., Meng, H., King, I., Wong, S., Saxena, C., & Yam, Y. (2022). Developing an AI literacy test for junior secondary students: The first stage. 2022 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE), 59-64. https://doi.org/10.1109/TALE54877.2022.00018.
Zhao, L., Wu, X., & Luo, H. (2022). Developing AI Literacy for Primary and Middle School Teachers in China: Based on a Structural Equation Modeling Analysis. Sustainability. https://doi.org/10.3390/su142114549.
Zheng, L., Niu, J., Zhong, L., & Gyasi, J. (2021). The effectiveness of artificial intelligence on learning achievement and learning perception: A meta-analysis. Interactive Learning Environments, 31, 5650 - 5664. https://doi.org/10.1080/10494820.2021.2015693.