فصلنامه روندها و دستاوردها در فناوری یادگیری

فصلنامه روندها و دستاوردها در فناوری یادگیری

شناسایی ظرفیت‌ها و چالش‌های هوش مصنوعی در ارزشیابی آموزش عالی: یک مطالعه به‌روش مرور نظام‌مند مبانی نظری

نوع مقاله : مقاله پژوهشی

نویسندگان
1 دانشجوی دکتری تکنولوژی آموزشی، دانشگاه علامه طباطبائی، تهران، ایران
2 کارشناسی ارشد مدیریت، دانشگاه تهران / مدیرعامل مرکز آموزش مجازی دانشگاهیان کشور، تهران، ایران
3 کارشناسی ارشد علم اطلاعات و دانش شناسی، دانشگاه علامه طباطبائی، تهران، ایران
چکیده
همگام با تحولات شگرف و سریع در حوزه فناوری‌ها، هوش مصنوعی به‌عنوان ابزاری قدرتمند توانسته است زندگی نوع بشر را در اتمام ابعاد به‌شدت تحت تأثیر قرار دهد. حوزه آموزش و یادگیری نیز از این قاعده مستثنی نیست و هوش مصنوعی توانسته است از ایده اولیه در خصوص آموزش تا برگ نهایی آموزش، یعنی ارزشیابی را متحول نماید. فرآیند ارزشیابی در تمام سطوح و مقاطع، همواره مورد رصد پژوهشگران جهت بررسی مثمر‌ثمر‌بودن فرآیند آموزشی است. در این حین، شناخت ظرفیت‌ها و چالش‌ها درارزشیابی آموزش عالی مارا در بهبود، مدیریت و کیفیت‌بخشی به فرآیند ارزشیابی کمک خواهد. از این رو، پژوهش حاضر به‌دنبال یک مرور نظام‌مند از ظرفیت‌ها و چالش های موجود در ارزشیابی نظام آموزش عالی است. به این جهت، پژوهش‌های انجام‌شده از فوریه 2015 تا ژوئن 2024 در مورد ظرفیت‌ها و چالش‌های هوش مصنوعی در ارزشیابی آموزش عالی را ارائه می‌دهد. این بررسی با هدف پرداختن به دو سؤال کلیدی: (1) ظرفیت‌های شناسایی‌شده و (2) چالش‌های پیش ‌رو در زمینه هوش مصنوعی در ارزشیابی آموزش عالی انجام شد. جستجوی جامع پایگاه‌های اطلاعاتی، مانند SAGE، Wiley Online Library و Science Direct ، 3281 پژوهش مشخص شد که از طریق یک فرآیند غربالگری دقیق، و انتخاب معیارهای انتخاب مقالات به نمونه نهایی 30 پژوهش مرتبط، محدود شد. یافته‌ها، چندین ظرفیت هوش مصنوعی، از قبیل شخصی‌سازی یادگیری، تأثیرات مثبت بر یادگیری دانشجویان، کاهش زمان در برنامه‌ریزی و مدیریت کارهای استادان، نمره‌دهی عینی‌تر دانشجویان، و خودکارسازی وظایف تکراری را شناسایی می‌کند. با این حال، پژوهش‌های مرور‌شده در این مقاله، همچنین چالش‌های مهمی مانند ملاحظات اخلاقی، ادغام با برنامه‌های درسی، زیرساخت‌های ناکافی، فقدان دانش فنی در بین استادان، مقاومت در برابر تغییر، و مشکلات در ارزشیابی فرآیندهای شناختی مرتبه بالاتر را نشان می‌دهد.
کلیدواژه‌ها
موضوعات

عنوان مقاله English

Identifying the capabilities and challenges of artificial intelligence in the evaluation of higher education: A systematic literature review study

نویسندگان English

Sakineh Sharifati 1
Hadi Shahbazi 2
Razieh Mardi 3
1 Ph.D. student of educational technology, Allameh Tabataba'i University, Tehran, Iran
2 Master of Management, University of Tehran, Managing Director of Virtual Education Center for Academicians of the country, Tehran, Iran
3 Allameh Tabataba'i University
چکیده English

Along with the tremendous and rapid developments in the field of technologies, artificial intelligence as a powerful tool has been able to greatly affect the life of mankind in all dimensions. The field of education and learning is not an exception from this rule and artificial intelligence has been able to evolve from the initial idea about education to the final form of education, i.e. evaluation. The evaluation process at all levels and stages is always monitored by researchers to check the effectiveness of the educational process. Meanwhile, knowing the capacities and challenges in the evaluation of our higher education will help in the improvement, management and quality of the evaluation process. Therefore, the current research seeks a systematic review of the capacities and challenges in the evaluation of the higher education system, for this reason, it presents the research conducted from February 2015 to June 2024 about the capacities and challenges of artificial intelligence in the evaluation of higher education. This survey was conducted with the aim of addressing tow key questions: (1) identified capacities and (2) upcoming challenges in the field of artificial intelligence in the evaluation of higher education. A comprehensive search of databases, such as SAGE, Wiley Online Library, and Science Direct, identified 3,281 studies that were narrowed down to a final sample of 30 relevant studies through a rigorous screening process, and the selection of article selection criteria. The findings show several capacities of artificial intelligence, such as personalization of learning, positive effects on student learning, reduction of time in planning and managing professors' work, more objective grading of students, and automation of repetitive tasks. However, the research reviewed in this article also reveals important challenges such as ethical considerations, integration with curricula, inadequate infrastructure, lack of technical knowledge among professors, resistance to change, and

کلیدواژه‌ها English

Artificial intelligence
Automatic evaluation
Educational evaluation
Higher education evaluation
Alam, A., & Mohanty, A. (2022). Foundation for the future of higher education or 'misplaced optimism'? Being human in the age of artificial intelligence. In M. Panda, S. Dehuri, M. R. Patra, P. K. Behera, G. A. Tsihrintzis, S.-B. Cho, & C. A. Coello Coello (Eds.), Innovations in intelligent computing and communication (pp. 17–29). Springer. https://doi.org/10.1007/978-3-030-97057-4_2
Algabri, H. K., Kharade, K., & Kamat, R. (2021). Promise, threats, and personalization in higher education with artificial intelligence. Webology, 18(6), 154–168.
Alotaibi, N. S., & Alshehri, A. H. (2023). Prospers and obstacles in using artificial intelligence in Saudi Arabia higher education institutions—The potential of AI-based learning outcomes. Sustainability, 15(13), 10723. https://doi.org/10.3390/su151310723
Bearman, M., Ryan, J., & Ajjawi, R. (2023). Discourses of artificial intelligence in higher education: A critical literature review. Higher Education, 86(2), 369–385. https://doi.org/10.1007/s10734-022-00937-2
Buchanan, C., Howitt, M. L., Wilson, R., Booth, R. G., Risling, T., & Bamford, M. (2021). Predicted influences of artificial intelligence on nursing education: Scoping review. JMIR Nursing, 4(1), e23933. https://doi.org/10.2196/23933
Burney, I. A., & Ahmad, N. (2022). Artificial intelligence in medical education: A citation-based systematic literature review. *Journal of Shifa Tameer-E-Millat University, 5*(1), 43–53.
Chaka, C. (2023). Fourth industrial revolution—A review of applications, prospects, and challenges for artificial intelligence, robotics and blockchain in higher education. Research and Practice in Technology Enhanced Learning, 18, 002. https://doi.org/10.58459/rptel.2023.18002
Charow, R., Jeyakumar, T., Younus, S., Dolatabadi, E., Salhia, M., Al-Mouaswas, D., ... & Wiljer, D. (2021). Artificial intelligence education programs for health care professionals: Scoping review. JMIR Medical Education, 7(4), e31043. https://doi.org/10.2196/31043
Chu, H. C., Hwang, G. H., Tu, Y. F., & Yang, K. H. (2022). Roles and research trends of artificial intelligence in higher education: A systematic review of the top 50 most-cited articles. Australasian Journal of Educational Technology, 38(3), 22–42. https://doi.org/10.14742/ajet.7529
Crompton, H., & Burke, D. (2023). Artificial intelligence in higher education: The state of the field. International Journal of Educational Technology in Higher Education, 20(1), 22. https://doi.org/10.1186/s41239-023-00392-8
Cruz-Benito, J. (2018). On data-driven systems analyzing, supporting and enhancing users' interaction and experience [Doctoral dissertation, Universidad de Salamanca].
Cugurullo, F. (2020). Urban artificial intelligence: From automation to autonomy in the smart city. Frontiers in Sustainable Cities, 2, 38. https://doi.org/10.3389/frsc.2020.00038
Deo, R. C., Yaseen, Z. M., Al-Ansari, N., Nguyen-Huy, T., Langlands, T. A. M., & Galligan, L. (2020). Modern artificial intelligence model development for undergraduate student performance prediction: An investigation on engineering mathematics courses. IEEE Access, 8, 136697–136724. https://doi.org/10.1109/ACCESS.2020.3010938
Etzioni, A., & Etzioni, O. (2017). Incorporating ethics into artificial intelligence. The Journal of Ethics, 21(4), 403–418. https://doi.org/10.1007/s10892-017-9252-4
Floryan, M., Dragon, T., Basit, N., Dragon, S., & Woolf, B. (2015). Who needs help? Automating student assessment within exploratory learning environments. In Artificial Intelligence in Education: 17th International Conference, AIED 2015, Proceedings (pp. 125–134). Springer. https://doi.org/10.1007/978-3-319-19773-9_13
García-Tudela, P. A., Prendes-Espinosa, M. P., & Solano-Fernández, I. M. (2020). Smart learning environments and ergonomics: An approach to the state of the question. Journal of New Approaches in Educational Research, 9(2), 245–258. https://doi.org/10.7821/naer.2020.7.563
Grivokostopoulou, F., Perikos, I., & Hatzilygeroudis, I. (2017). An educational system for learning search algorithms and automatically assessing student performance. International Journal of Artificial Intelligence in Education, 27(2), 207–240. https://doi.org/10.1007/s40593-016-0121-0
Grunhut, J., Wyatt, A. T., & Marques, O. (2021). Educating future physicians in artificial intelligence (AI): An integrative review and proposed changes. Journal of Medical Education and Curricular Development, 8, 23821205211036836. https://doi.org/10.1177/23821205211036836
Harmon, J., Pitt, V., Summons, P., & Inder, K. J. (2021). Use of artificial intelligence and virtual reality within clinical simulation for nursing pain education: A scoping review. Nurse Education Today, 97, 104700. https://doi.org/10.1016/j.nedt.2020.104700
Jani, K. H., Jones, K. A., Jones, G. W., Amiel, J., Barron, B., & Elhadad, N. (2020). Machine learning to extract communication and history-taking skills in OSCE transcripts. Medical Education, 54(12), 1159–1170. https://doi.org/10.1111/medu.14280
Kaila, E., Kurvinen, E., Lokkila, E., & Laakso, M. J. (2016). Redesigning an object-oriented programming course. ACM Transactions on Computing Education, 16(4), 1–21. https://doi.org/10.1145/2940330
Kirubarajan, A., Young, D., Khan, S., Crasto, N., Sobel, M., & Sussman, D. (2022). Artificial intelligence and surgical education: A systematic scoping review of interventions. Journal of Surgical Education, 79(2), 500–515. https://doi.org/10.1016/j.jsurg.2021.09.009
Li, F., He, Y., & Xue, Q. (2021). Progress, challenges and countermeasures of adaptive learning. Educational Technology & Society, 24(3), 238–255.
Lin, Q., Zhu, Y., Zhang, S., Shi, P., Guo, Q., & Niu, Z. (2019). Lexical based automated teaching evaluation via students' short reviews. Computer Applications in Engineering Education, 27(1), 194–205. https://doi.org/10.1002/cae.22067
Lu, O. H. T., Huang, A. Y. Q., Tsai, D. C. L., & Yang, S. J. H. (2021). Expert-authored and machine-generated short-answer questions for assessing students learning performance. Educational Technology & Society, 24(3), 159–173.
Luchoomun, T., Chumroo, M., & Ramnarain-Seetohul, V. (2019). A knowledge based system for automated assessment of short structured questions. In 2019 IEEE Global Engineering Education Conference (EDUCON) (pp. 1349–1352). IEEE. https://doi.org/10.1109/EDUCON.2019.8725188
Maicher, K. R., Zimmerman, L., Wilcox, B., Liston, B., Cronau, H., Macerollo, A., ... & Danforth, D. R. (2019). Using virtual standardized patients to accurately assess information gathering skills in medical students. Medical Teacher, 41(9), 1053–1059. https://doi.org/10.1080/0142159X.2019.1616684
Manhiça, R., Santos, A., & Cravino, J. (2022). The use of artificial intelligence in learning management systems in the context of higher education: Systematic literature review. In 2022 17th Iberian Conference on Information Systems and Technologies (CISTI) (pp. 1–6). IEEE. https://doi.org/10.23919/CISTI54924.2022.9820306
Mirchi, N., Bissonnette, V., Yilmaz, R., Ledwos, N., Winkler-Schwartz, A., & Del Maestro, R. F. (2020). The Virtual Operative Assistant: An explainable artificial intelligence tool for simulation-based training in surgery and medicine. PLOS ONE, 15(2), e0229596. https://doi.org/10.1371/journal.pone.0229596
Mousavi, A., Schmidt, M., Squires, V., & Wilson, K. (2021). Assessing the effectiveness of student advice recommender agent (SARA): The case of automated personalized feedback. International Journal of Artificial Intelligence in Education, 31(3), 603–621. https://doi.org/10.1007/s40593-020-00217-z
Narciss, S., Sosnovsky, S., Schnaubert, L., Andrès, E., Eichelmann, A., Goguadze, G., & Melis, E. (2014). Exploring feedback and student characteristics relevant for personalizing feedback strategies. Computers & Education, 71, 56–76. https://doi.org/10.1016/j.compedu.2013.09.011
Ocaña-Fernández, Y., Valenzuela-Fernández, L. A., & Garro-Aburto, L. L. (2019). Inteligencia artificial y sus implicaciones en la educación superior. Propósitos y Representaciones, 7(2), 536–568. https://doi.org/10.20511/pyr2019.v7n2.274
O'Neil, C. (2017). Weapons of math destruction: How big data increases inequality and threatens democracy. Crown.
Ouyang, F., Zheng, L., & Jiao, P. (2022). Artificial intelligence in online higher education: A systematic review of empirical research from 2011 to 2020. Education and Information Technologies, 27(6), 7893–7925. https://doi.org/10.1007/s10639-022-10925-9
Rabelo, A., Rodrigues, M. W., Nobre, C., Isotani, S., & Zárate, L. (2024). Educational data mining and learning analytics: A review of educational management in e-learning. Information Discovery and Delivery, 52(2), 149–163. https://doi.org/10.1108/IDD-06-2023-0058
Rodriguez-Ascaso, A., Boticario, J. G., Finat, C., & Petrie, H. (2017). Setting accessibility preferences about learning objects within adaptive eLearning systems: User experience and organizational aspects. Expert Systems, 34(4), e12187. https://doi.org/10.1111/exsy.12187
Saghiri, M. A., Vakhnovetsky, J., & Nadershahi, N. (2022). Scoping review of artificial intelligence and immersive digital tools in dental education. Journal of Dental Education, 86(6), 736–750. https://doi.org/10.1002/jdd.12856
Salas-Pilco, S. Z., Xiao, K., & Hu, X. (2022). Artificial intelligence and learning analytics in teacher education: A systematic review. Education Sciences, 12(8), 569. https://doi.org/10.3390/educsci12080569
Samarakou, M., Fylladitakis, E., Fruh, W. G., Karolidis, D., Hatziapostolou, A., Athinaios, S., & Grigoriadou, M. (2016). Evaluation of an intelligent open learning system for engineering education. *Knowledge Management and E-Learning, 8*(3), 496–513.
Santos, O. C., & Boticario, J. G. (2014). Involving users to improve the collaborative logical framework. The Scientific World Journal, 2014, 893525. https://doi.org/10.1155/2014/893525
Saplacan, D., Herstad, J., & Pajalic, Z. (2018). Feedback from digital systems used in higher education: An inquiry into triggered emotions—Two universal design oriented solutions for a better user experience. In Transforming our world through design, diversity and education (pp. 421–430). IOS Press.
Sarkis-Onofre, R., Pereira-Cenci, T., Tricco, A. C., Demarco, F. F., Moher, D., & Cenci, M. S. (2019). Systematic reviews in restorative dentistry: Discussing relevant aspects. Journal of Esthetic & Restorative Dentistry, 31(3), 222–232. https://doi.org/10.1111/jerd.12477
Sourani, M. (2019). Artificial intelligence: A prospective or real option for education? Al Jinan, 11, 121–139.
Sun, Z., Anbarasan, M., & Praveen Kumar, D. (2021). Design of online intelligent English teaching platform based on artificial intelligence techniques. Computational Intelligence, 37(3), 1166–1180. https://doi.org/10.1111/coin.12425
Ulum, Ö. G. (2020). A critical deconstruction of computer-based test application in Turkish State University. Education and Information Technologies, 25(6), 4883–4896. https://doi.org/10.1007/s10639-020-10195-3
Wang, L., Hu, G., & Zhou, T. (2018). Semantic analysis of learners' emotional tendencies on online MOOC education. Sustainability, 10(6), 1921. https://doi.org/10.3390/su10061921
Zhang, W., Cai, M., Lee, H. J., Evans, R., Zhu, C., & Ming, C. (2024). AI in medical education: Global situation, effects and challenges. Education and Information Technologies, 29(4), 4611–4633. https://doi.org/10.1007/s10639-023-11992-2

  • تاریخ دریافت 27 شهریور 1403
  • تاریخ بازنگری 15 آذر 1403
  • تاریخ پذیرش 01 دی 1403
  • تاریخ انتشار 01 دی 1403