Applied and Computational Engineering

- The Open Access Proceedings Series for Conferences


Proceedings of the 5th International Conference on Computing and Data Science

Series Vol. 17 , 23 October 2023


Open Access | Article

Procedural content generation for VR educational applications: The investigation of AI-based approaches for improving learning experience

Yifei Wang * 1
1 University of Pennsylvania

* Author to whom correspondence should be addressed.

Applied and Computational Engineering, Vol. 17, 23-31
Published 23 October 2023. © 2023 The Author(s). Published by EWA Publishing
This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Citation Yifei Wang. Procedural content generation for VR educational applications: The investigation of AI-based approaches for improving learning experience. ACE (2023) Vol. 17: 23-31. DOI: 10.54254/2755-2721/17/20230905.

Abstract

In recent years, artificial intelligence (AI) has witnessed significant advancements in the field of education, with its ability to personalize and adapt content to individual student needs. In parallel, virtual reality (VR) has emerged as a powerful tutorial tool, providing immersive and interactive experiential learning experiences which has the advantages of improving students' motivation and engagement. Previous researchers have demonstrated the potential of ML algorithms, particularly RL, for generating educational content and VR environments. To create high-quality content, researchers have started exploring the integration of Machine Learning (ML) and Reinforcement Learning (RL) algorithms into Procedural Content Generation (PCG) methods for automatically generating both textual and non-textual content such as practice questions, quizzes, VR learning environments, etc., which have the potential to increase the efficiency and effectiveness of educational interventions. Nonetheless, the development of these techniques requires addressing several challenges. Significant advancements are yet to be made in developing and refining these algorithms to produce high-quality and effective educational content for VR applications. This article provides a comprehensive overview of the current state of research in reinforcement AI learning content generation for VR educational applications. For each area, it discusses the state-of-the-art techniques, applications, limitations, and challenges faced in development, covering the use of natural language processing, reinforcement learning, and machine learning algorithms. The review concludes by highlighting some of the key opportunities for future research in this field, including the development of more sophisticated models and the exploration of new applications of machine learning in educational technology.

Keywords

procedural content generation, reinforcement learning, machine learning, VR educational applications

References

1. Guttentag D A 2010 Virtual reality: Applications and implications for tourism Tourism management 31(5) 637-651

2. Choi S Jung K & Noh S D 2015 Virtual reality applications in manufacturing industries: Past research, present findings, and future directions. Concurrent Engineering 23(1) 40-63

3. Jensen L Konradsen F 2018 A review of the use of virtual reality head-mounted displays in education and training Education and Information Technologies 23 1515-1529

4. Kavanagh S Luxton-Reilly A Wuensche B Plimmer B 2017 A systematic review of virtual reality in education Themes in Science and Technology Education 10(2) 85-119

5. Dickey M D 2005 Brave new (interactive) worlds: A review of the design affordances and constraints of two 3D virtual worlds as interactive learning environments Interactive learning environments 13(1-2) 121-137

6. Dawley L Dede C 2014 Situated learning in virtual worlds and immersive simulations Handbook of research on educational communications and technology 723-734

7. Çaliskan O 2011 Virtual field trips in education of earth and environmental sciences Procedia-Social and Behavioral Sciences 15 3239-3243

8. Barata P N A et al 2015 Consolidating learning in power systems: Virtual reality applied to the study of the operation of electric power transformers IEEE Transactions on Education 58(4) 255-261

9. Witmer B G Singer M J 1998 Measuring presence in virtual environments: A presence questionnaire Presence 7(3) 225-240

10. Winn W et al 2002 When does immersion in a virtual environment help students construct understanding In Proceedings of the International Conference of the Learning Sciences, ICLS Vol. 206 pp. 497-503

11. Alhalabi W 2016 Virtual reality systems enhance students’ achievements in engineering education Behaviour & Information Technology,35(11) 919-925

12. Liu L et al 2009 Automated Generation of Example Contexts for Helping Children Learn Vocabulary In International Workshop on Speech and Language Technology in Education

13. Chen W Mostow J 2011 Using Automatic Question Generation to Evaluate Questions Generated by Children In 2011 AAAI Fall Symposium Series

14. Mostow J et al 2017 Developing, evaluating, and refining an automatic generator of diagnostic multiple choice cloze questions to assess children's comprehension while reading. Natural Language Engineering 23(2) 245-294

15. Mostow J et al 2015 Automatic Identification of Nutritious Contexts for Learning Vocabulary Words. International Educational Data Mining Society

16. Lopez C E et al 2019 Reinforcement learning content generation for virtual reality applications. In International Design Engineering Technical Conferences and Computers and Information in Engineering Conference Vol. 59179 p V001T02A009 American Society of Mechanical Engineers

17. López C E et al 2020 Deep reinforcement learning for procedural content generation of 3d virtual environments Journal of Computing and Information Science in Engineering 20(5)

18. Tsaramirsis G et al 2016 Towards simulation of the classroom learning experience: Virtual reality approach In 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom) pp 1343-1346 IEEE

19. Akçayır M et al 2017 Advantages and challenges associated with augmented reality for education: A systematic review of the literature Educational research review 20 1-11

20. Mikropoulos T A et al 2011 Educational virtual environments: A ten-year review of empirical research (1999–2009) Computers & education 56(3) 769-780

21. Arulkumaran K et al 2017 Deep reinforcement learning: A brief survey IEEE Signal Processing Magazine 34(6) 26-38

22. Mostow J Beck J 2006 Some useful tactics to modify, map and mine data from intelligent tutors. Natural Language Engineering 12(2) 195-208

23. Beck J E et al 2008 Does help help? Introducing the Bayesian Evaluation and Assessment methodology. In Intelligent Tutoring Systems: 9th International Conference, ITS 2008, Montreal Canada June 23-27 2008 Proceedings 9 pp. 383-394 Springer Berlin Heidelberg

24. Mostow J et al 1999 Giving help and praise in a reading tutor with imperfect listening—because automated speech recognition means never being able to say you're certain CALICO journal, 407-424

25. Kaelbling L P et al 1996 Reinforcement learning: A survey. Journal of artificial intelligence research 4 237-285

26. Xu X et al 2014 Reinforcement learning algorithms with function approximation: Recent advances and applications. Information sciences 261 1-31

27. Wang, P et al 2017 Interactive Narrative Personalization with Deep Reinforcement Learning In IJCAI pp 3852-3858

28. Rowe J et al 2018 Toward automated scenario generation with deep reinforcement learning in gift In Proceedings of the Sixth Annual GIFT User Symposium pp 65-74

29. Cunningham J et al 2020 Multi-context generation in virtual reality environments using deep reinforcement learning In International Design Engineering Technical Conferences and Computers and Information in Engineering Conference Vol 83983 p V009T09A072 American Society of Mechanical Engineers

30. Hullett K Mateas M 2009 Scenario generation for emergency rescue training games. In Proceedings of the 4th International Conference on Foundations of Digital Games pp 99-106

31. Smith A M et al 2012 A case study of expressively constrainable level design automation tools for a puzzle game. In Proceedings of the International Conference on the Foundations of Digital Games pp 156-163

32. Rodrigues L et al 201 A math educacional computer game using procedural content generation In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE) Vol 28 No 1 p 756

33. Hooshyar D et al 2018 A procedural content generation-based framework for educational games: Toward a tailored data-driven game for developing early English reading skills Journal of Educational Computing Research 56(2) 293-310

34. Hooshyar D et al 2018 A data‐driven procedural‐content‐generation approach for educational games Journal of Computer Assisted Learning 34(6) 731-739

35. Spain R et al 2022 A reinforcement learning approach to adaptive remediation in online training The Journal of Defense Modeling and Simulation 19(2) 173-193

36. Corno L Mandinach E B 1983 The role of cognitive engagement in classroom learning and motivation. Educational psychologist 18(2) 88-108

37. Chao T et al 2016 Using digital resources for motivation and engagement in learning mathematics: Reflections from teachers and students Digital Experiences in Mathematics Education 2 253-277

Data Availability

The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. Authors who publish this series agree to the following terms:

1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this series.

2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this series.

3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See Open Access Instruction).

Volume Title
Proceedings of the 5th International Conference on Computing and Data Science
ISBN (Print)
978-1-83558-025-7
ISBN (Online)
978-1-83558-026-4
Published Date
23 October 2023
Series
Applied and Computational Engineering
ISSN (Print)
2755-2721
ISSN (Online)
2755-273X
DOI
10.54254/2755-2721/17/20230905
Copyright
© 2023 The Author(s)
Open Access
This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited

Copyright © 2023 EWA Publishing. Unless Otherwise Stated