Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Virtual Reality in Vocational Training: A Study Demonstrating the Potential of a VR-based Vehicle Painting Simulator for Skills Acquisition in Apprenticeship Training

Virtual Reality in Vocational Training: A Study Demonstrating the Potential of a VR-based Vehicle... Previous studies on Virtual Reality (VR)-enriched learning pointed out the advantages of immersive learning for the development of competencies. In the context of vocational education in vehicle painting, training opportunities are severely limited for many reasons. VR can be utilized to develop a comprehensive learning environment with authentic train- ing tasks. Besides the need to train psychomotor skills, vehicle painting procedures are complex tasks requiring incremental training to develop knowledge, skills, and attitudes. This study aims to evaluate a VR training application for vehicle painting, focusing on the development of professional competencies regarding skills, knowledge, and attitudes. 47 apprentices participated in the evaluation study. A VR-simulated painting booth was developed based on the 4 C/ID model by van Merriënboer, where they dealt with typical painting jobs on 3D workpieces (e.g., car wings, engine hood). Within the descriptive-inferential study, no significant differences between the types of competencies were revealed. The training application supports the acquisition of skills, knowledge, and attitudes equally. Further results regarding usability, cognitive load, etc., are promising. The essential finding of this study is that the VR training application is generally suit - able for supporting craftsmanship within the field of vehicle painting. Since training op - portunities for apprentices in this context are often rare, VR offers a unique solution especially for skills training if it follows a proven instructional model for the development of competencies. Keywords Virtual Reality · 4C/ID model · Competence development · Skills acquisition · Vocational education · Apprenticeship training Extended author information available on the last page of the article 1 3 M. Mulders et al. 1 Introduction Virtual Reality (VR) has been widely adopted in various domains within vocational edu- cation (Allcoat & van Mühlenen, 2018; Hamilton et al., 2021; Merchant et al., 2014; Mikropoulos & Natsis, 2011), including surgery (McCloy & Stone, 2001), construction management (Sacks, Perlman, & Barak, 2013), weld training (Stone et al., 2013), and mili- tary training (Bhagat et al., 2016), as a way to engage and motivate learners, decrease time to achieve skill mastery, cut down on material usage, and improve performance outcomes. The technology has been applied for training a wide range of real-world tasks and procedures. It is of note that VR technologies seem to be particularly suited for training psychomotor skills and have limited benefits for the acquisition of declarative knowledge (e.g., Jensen & Konradsen, 2018; Makransky & Petersen, 2021; Xie, 2021). Traditional training methods are often not sufficient to support vocational skills acquisition adequately. In general, real- world vocational skills training has the following limitations: (1) it might be expensive due to the cost of preparing real-world training materials and hiring human coaches, (2) it might consume time and effort to set up the real-world training, (3) it might be counterintuitive and unappealing due to the lack of visual aids such as 3D animations, and (4) it might not be possible to train some skills in the real world (e.g., emergency procedures) that can only be safely trained in simulators. Depending on the domain, VR could reduce the costs of vocational skills training while increasing the number of learning opportunities and training cycles. Moreover, as VR learning scenarios mainly involve computer-generated 3D graph- ics, VR developers can easily create a variety of scenarios from existing 3D assets. These simulated scenarios can be applied for the training of learners with different prerequisites (at the beginning of the training vs. immediately before the final exam). Besides, VR applica - tions allow learning in the comfort of a more personal spaces. This is especially important for cases where an apprentice might feel uncomfortable about their actions in a real-world training environment due to the presence of a trainer. Moreover, VR training provides a safe environment with minimal exposure to dangerous situations and no danger to dam- age expensive tools and machinery (Conges et al., 2020; Li et al., 2017). Altogether, VR technology has become popular in recent years and its effectiveness for vocational train - ing has been demonstrated (e.g., Xie, 2021). Thus, VR offers a unique solution to address various shortcomings in the development of vocational skills. The technology seems to be predestined to support skills training, whereas the training of knowledge and attitudes may be further addressed by other instructional methods in the real world. However, the impact of VR on various dimensions of learning in the different fields of education needs further research and evaluation (Kim et al., 2020). Generally, apprentices in various vocational settings are often inexperienced, not able to carry out vocational tasks by themselves, and hence, less confident. Here, VR can provide many training opportunities with the possibil - ity to repeat specific aspects several times. Thus, apprentices gain training experience and become more confident before applying skills in real-world scenarios. This means that VR learning environments are not perceived as a substitute for real-world training, but they can prepare apprentices adequately and can be added to real-world training to improve and accelerate mastery efficiently. Xie (2021) comprehensively reviewed a set of VR skills trainings and distinguished between the following domains: first responder training, medical training, military training, transportation, workforce training, and interpersonal skills training. 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… Our following study is situated in the context of workforce training and there, in the field of vehicle painting. In this field of vocational education, authentic artifacts for training are often rare. Vehicle painters must operate effectively in a complex environment. Often, how - ever, they have surprisingly limited opportunities to practice procedures before applying them on real workpieces from cars (e.g., Zender et al., 2019). In the field of vehicle painting, various methods and techniques of applying a coat to a workpiece under differing conditions must be trained thoroughly. For example, new part paintings as well as spot repair painting, which means painting over a small, damaged spot on the car, have to be done. However, frequent and repeated training of these skills is hampered by economic (e.g., material costs), physical (e.g., environmentally sensitive materials), and social factors (e.g., limited support capacity). Skills training in vehicle painting typically relies heavily on memorization and routiniza- tion of procedural steps from criterion-based checklists. However, since apprentices often have limited opportunities to practice, they struggle to build routines for these procedures. VR can offer a unique and sophisticated solution to address this training problem. In a VR simulator, learners are placed in a realistic 3-dimensional environment (here: a paint booth), where they can safely practice without causing any harm, such as producing workpieces, which are not suitable for customers due to mistakes in production, or wasting paint. Additionally, apprentices are highly motivated and engaged in environments that use novel and appealing technologies such as VR (e.g., Mulders 2020). Vehicle painting seems to be a particularly interesting field for the application of VR. Psychomotor tasks are typically trained in repetition loops to strengthen the routine of skills. Moreover, haptic feedback from 3D workpieces is not required here, as these are not touched during the application. Instead of commercial controllers, a highly authentic spray gun (from 3D printing) can be provided, which facilitates transfer to practice. Additionally, feedback on the quality of the coating, for example, regarding layer thickness, can be pro- vided immediately, whereas in the real world, it takes several hours until coatings are dried and results become visible and assessable. In the next sections, we provide further details on the theoretical background of VR in vocational training and our methodological approach to analyzing the effects on the acquisi - tion of competencies. Then, we present the results of our study. Finally, we discuss these results regarding the perspectives of VR in vocational education. The article closes with limitations, an outlook for future research, and a conclusion. 2 Background VR is an emerging technology using computer-generated graphics to produce a realistic 3D environment for multiple sensory experiences (Burdea & Coiffet, 2006) including a tracking system (input) and a display system (output) (Kulpa et al., 2015). The user is fully immersed in a computer-generated world. Their viewpoint changes according to head movements (Slater et al., 2009; Slater & Sanchez-Vives, 2016). There are several elements of VR expe- riences, distinguished roughly by the degree to which the user’s sensory perception is co- opted. HMDs with headphones, wearable haptic clothing, and other equipment that allows the user to walk freely exemplify the most common consumer-grade VR setups. VR is not 1 3 M. Mulders et al. limited to visual information, as the auditory, haptic, kinesthetic, and olfactory senses can also be technologically simulated. While recent research has promoted technologically advanced VR learning environ- ments, it has often been questioned if and how VR can be transferred from laboratory set- tings to everyday learning in schools and other educational environments (Dengel et al., 2021). There is a need to demonstrate and evaluate VR applications for training in real (accredited) curricula and formal education. In addition, many VR applications have been developed without substantial reference to instructional methods or research on learning with digital technology, seemingly reducing the acquisition of competence to a mode of “trial & error” (Mulders et al., 2020). Therefore, we developed an approach that is situated in vocational education and a train- ing environment based on the three-year apprenticeship curriculum for vehicle painting that is nationally accredited in Germany . The learning application is based on the four- component instructional design (4 C/ID) model, which has been successfully applied and evaluated in various contexts and domains (e.g., Kester & van Merriënboer 2021; van Mer- riënboer, Jelsma, & Paas, 1992; van Merriënboer, Clark, & de Croock, 2002; van Merriën- boer & Kirschner 2017). The 4C/ID model is a framework for developing instruction on complex tasks including skills development. To our knowledge, the 4C/ID model has not been applied to other VR trainings so far. Thus, we seek to develop a meaningful training application aligned to the principles of the 4 C/ID model. Here, competencies are defined as complex cognitive skills, consisting of integrated sets of constituent skills with their under- lying knowledge structures and attitudes (van Merriënboer, 1997). A detailed description of how we applied the 4 C/ID models principles to VR and the vocational field of vehicle painting can be found in Mulders (2022) and Zender et al. (2019). Previous studies on VR-enriched training pointed out its advantages for the acquisition of skills, but vehicle painting procedures are complex tasks requiring the training of whole tasks including all components of competencies (i.e., skills, knowledge, attitudes). Also, practitioners asked for the integration of the various relevant components in the VR applica- tion (e.g., knowing how to prepare workpieces, attitudes towards personal protective equip- ment) to fulfill a customer order successfully, and not only the training of motor skills to apply the coat. Therefore, we have developed a comprehensive learning application with authentic train- ing tasks for the field of vehicle painting using VR that addresses the integrated acquisi - tion of all components of competencies: skills, knowledge, and attitudes. Still, the question remains if the virtual environment fosters competence acquisition sufficiently. For example, presenting textual information in VR is somehow challenging. In vehicle painting, work plans, technical datasheets, etc., are often text-based and wordy and might be difficult to grasp when presented in the VR environment. Our study aims to evaluate the VR training application with an instructional approach based on the 4C/ID model. We investigated if the VR training application is generally usable and suited to supporting competence acquisition for apprentices in the domain of vehicle painting. https://www.bibb.de/dienst/berufesuche/de/index_berufesuche.php/profile/apprenticeship/67867684 . 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… Fig. 1 Apprentice learning with the VR-based painting simulator 3 Methods The VR system used in this study was developed during a 38-month research project. The project was conducted by representatives from different disciplines, such as computer sci - entists and instructional designers. Within the project, all training elements were developed from scratch. The 3D environment and its components were programmed with Unity. To develop an instructional design, several interviews with practical partners were conducted and curricula were studied. The result of the project is the VR painting simulator, which consists of several task classes (e.g., repair painting) and corresponding learning tasks. Pre- requisites of use for the VR painting simulator are a gaming computer and a connected head-mounted display (HMD; here: HTC Vive), a pressure tube, as well as one commer- cial controller onto which a 3D-printed spray gun is mounted (see Fig. 1). Moreover, an additional authoring tool allows teachers to design their tasks and assign these to certain apprentices. At the end of the project, we tested the training tool with apprentices in vehicle painting who should use the tool prospectively to practice skills repeatedly with immediate and consistent feedback. The available VR training includes a suitable variation and pro- gression of learning tasks, which can be adapted by a trainer based on a defined number of parameters (e.g., type of workpiece, number of coatings) and in terms of complexity. With this feature, variations of learning tasks can be designed similarly to different customer orders (e.g., Mulders, 2022). In the VR training application, apprentices work on various learning tasks, which are all designed as typical customer orders. To do this, the training is situated in a simulated The HandLeVR research project (01.01.19–28.02.22; funding code: 01PV18002B) is funded by the German Federal Ministry of Education and Research with partners from the University of Potsdam (computer sci- ence), the University of Duisburg-Essen (instructional design), ZWH e.V. (chamber of industry), and Daimler AG Berlin-Ludwigsfelde (international car manufacturer). A total of 35.6 person-months was necessary for the technical development of the VR training application (tasks such as project coordination, transfer, evalua- tion, etc., excluded). The software and accompanying materials are available as open source at https://github. com/HandLeVR. https://unity.com/de. 1 3 M. Mulders et al. paint booth that contains a workpiece to be painted as a 3D model (e.g., an engine hood). Before and after the painting process, apprentices are equipped with the requisite knowl- edge and attitudes. A virtual trainer, instructional videos, as well as multiple choice and sorting tasks provide relevant information. During the painting process, the apprentices’ performance regarding several parameters (e.g., paint consumption, distance to the work- piece) is recorded and stored. After each task, the apprentice is informed about their results and achievements. They receive visual feedback, e.g., by illustrating layer thickness on a heatmap on the workpiece. Different colors indicate layer thickness (detailed description in Mulders (2022) and Zender et al., (2019)). The learning environment consists of a progres- sion of learning tasks with different training instructions and supporting information follow - ing the principles of the 4C/ID model. The presented research investigates the overall effectiveness of a VR learning applica - tion in the vocational field of vehicle painting. One concern relevant to learning in VR environments is the cognitive load experienced when using VR (Makransky & Petersen, 2021). Makransky, Terkildsen, and Mayer (2019) as well as Huang and colleagues (2020) showed that learning in VR may overload and distract learners, resulting in poorer learn- ing outcomes. Usability was identified as another decisive factor towards learning in VR. Usability refers to the quality and accessibility of the technology in use and is assumed to impact learning processes in VR (Lee et al., 2010; Radianti et al., 2020). Another research interest focuses on learning in VR regarding the competence to be acquired. As Jensen and Konradsen (2018) as well as Makransky and Petersen (2021) mentioned, VR seems to be particularly suited for training psychomotor skills and has limited benefits for knowledge acquisition. To investigate learning processes within the VR painting simulation in terms of com- petence acquisition, we conducted an evaluative single-group study with post-tests and behavioral assessments. In the following sections, we outline the methods of our descrip- tive-inferential study in detail. 3.1 Sample and Context A total of 47 apprentices in vehicle painting (11 female) participated in the study: 16 from Daimler AG, an international car manufacturer, and 31 from other national training institu- tions. Their age varies between 17 and 37 (M = 20.91, SD = 3.65). The study took place as part of their 3-year apprenticeship. 3.2 VR Painting Simulator Following the 4C/ID model, the VR painting simulator includes a set of learning tasks that differ regarding various parameters (e.g., type of workpiece) as well as in terms of com - plexity (van Merriénboer & Kirschner, 2017). It intends to help apprentices achieve the overarching goal of vocational action competence. In the VR application, apprentices work on learning tasks. Prototypical learning tasks were developed according to the 4C/ID model of competence development (van Merriënboer et al., 2002). This was done in cooperation with experienced corporate trainers and apprentices in the field of vehicle painting. The tasks have been evaluated and re-developed iteratively through several design cycles. For example, one learning task illustrates a single-layer refinishing on an engine hood. To work 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… Fig. 2 The paint booth Fig. 3 The virtual monitor on a learning task, the apprentices immerse in a paint booth that has been recreated in detail and contains a 3D workpiece clamped on a painting stand (see Fig. 2). Moreover, there is a (virtual) monitor (see Fig. 3) in the 3D environment and a poster to test the spray pattern. In their dominant hand, the apprentice holds a spray gun produced from a 3D printer (see Fig. 3). In the 3D environment, a virtual trainer (presented as an avatar) is permanently present, guiding the apprentice through the task and providing feedback at certain steps (see Fig. 3). In addition to the painting process itself, the environment contains supportive information, mostly for preparatory and follow-up activities, and part-task training follow- ing the 4C/ID model (e.g., self-made videos by apprentices about using personal protective equipment). During the painting process, the apprentice is supported by a beam indicating the proper distance to a workpiece (see Fig. 5) and by supportive oral and written feedback from the virtual trainer. The feedback system is adaptive, depending on the learner’s perfor- mance and level of expertise. For example, for beginners, elaborate explanations regarding 1 3 M. Mulders et al. Fig. 4 The 3D printed spray gun Fig. 5 The beam indicating the proper distance to the workpiece the distance to the workpiece and its implication on the paint amount are given, whereas experienced learners are prompted with visual stimuli signaling that they are too close or 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… Table 1 NASA-TLX results subscale M SD mental demand 47.17 25.33 physical demand 46.05 28.09 temporal demand 17.50 18.85 effort 35.09 24.98 frustration 25.66 28.00 too far away from the workpiece. During coat application, the performance is recorded and stored along with a variety of parameters (e.g., layer thickness) and can be replayed for reflection and further discussions with a (real) instructor or supervisor. A learning task closes with feedback based on several parameters (e.g., wasted coat) and feedback on the quality of the application (i.e., heatmap). 3.3 Instruments This descriptive-inferential evaluation study generates data from (1) questionnaires and (2) behavioral tracking. Demographic data, previous experiences with VR technology, and aversive impressions within VR were captured by several closed-ended single- and multi- ple-choice questions. Moreover, validated as well as self-created questionnaires were used during the evaluation study. Validated questionnaires: The subjective cognitive load experienced within VR was tested by the NASA-TLX (Hart, 2006; α = 0.68 to α = 0.74). The questionnaire temporal demand frustration is based on six subscales (see Table 1, e.g., temporal demand) which are rated within a 100-points range (e.g., How mentally demanding was the task?). The overall usability of the VR painting application was measured by the User Experience Questionnaire (UEQ; Schrepp 2015; α = 0.72 to α = 0.77). Pairs of opposites (e.g., attractive - unat- attractiveness novelty tractive) were graded on a seven-point Likert scale resulting in six subscales (e.g., novelty). Self-created questionnaires: Furthermore, apprentices were asked to what extent the learning tasks contributed to the acquisition of competencies, i.e., knowledge, skills, and attitudes, to test if there are differences between the types of competency gains (e.g., The learning task has helped me know more about new part painting.). The scale ranges from 1 (absolutely disagree) to 5 (fully agree). The internal consistency ranges from α = 0.70 knowledge to α = 0.74. Based on the identical scale, apprentices were asked if the application is sat- skills isfying (α = 0.71) and recommendable (α = 0.77). Further data: In addition to data from questionnaires, the VR system itself provided data. Success criteria (e.g., layer thickness, angle) could, thus, flow into the evaluation. 3.4 Procedure On completion of the second iteration of the system, we tested two prototypical learning tasks of the VR training application. The study took place in several training centers within Germany. For this, researchers and apprentices came together in several one-day work- shops. First, apprentices watched a video tutorial explaining how to navigate, and select and apply paint within VR. After the HMD and the spray gun were adjusted, the apprentices spent some minutes without any action to become comfortable with the new situation. Then, they worked on two different tasks both illustrating single-layer coating. The apprentices 1 3 M. Mulders et al. Fig. 6 The beam indicating the proper distance to the workpiece performed alone and independently without external help (see Fig. 1). The test administra- tors followed a guideline to keep the test conditions as uniform as possible. They made sure that the maximum duration of headset use did not exceed 30 min (Smith & Burd, 2019). Subsequently, each apprentice filled in questionnaires (approximately 35 min) and took part in a discussion group (approximately 45 to 60 min). 3.5 Data Evaluation We decided to provide means and standard deviations as well as t-tests to check if there are significant differences between the acquisition of skills, attitudes, and knowledge. We checked normality of the sample for the tested variables by Shapiro-Wilk-Tests (p > .05). 4 Results In this section, we outline the results of our study. For 75% of the apprentices, the first language is German, others named Armenian or Turkish. Half of the participants (49%) reported having previous experience with VR, but in almost all cases extremely rarely. Par- ticipants were asked about unpleasant experiences. In a few cases, they reported difficulties with seeing sharply, disorientation, or general discomfort. To answer our research question whether the VR training application is generally usable and suitable for supporting competence acquisition within the vocational training of vehicle painters, we gained several data. First, the subjective cognitive load was surveyed by NASA-TLX (Hart, 2006). The apprentices reported an overall workload of M = 31.09 (SD = 25.05). Further data are pro- vided in Table 1. Second, apprentices rated the usability of the VR painting application based on the UEQ (Schrepp, 2015). The results are visualized in Fig. 6. 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… Table 2 Competencies results subscale M SD knowledge 3.17 0.79 skills 3.21 0.86 attitudes 3.45 0.86 Third, we gained data from behavioral tracking. These data revealed how difficult it was to maintain the correct distance as well as the correct angle to a workpiece. The correct dis- tance was maintained 49,54%, and the correct angle 45,43% of the time. Fourth, we questioned to what extent the learning tasks contributed to the acquisition of competencies. From these ratings, it can be concluded that the learning tasks support the acquisition of skills, knowledge, and attitudes satisfactorily (see Table 2). Paired t-tests revealed no significant differences between types of competencies, whether between knowl - edge and skills (t(46) = − 0.34, p = .74, n.s.), knowledge and attitudes (t(46) = 2.45, p = .08, n.s.), or skills and attitudes (t(46) = 2.20, p = .11, n.s.). Finally, apprentices were asked to give an overall rating of their experience. The con- tentment is M = 4.30 (SD = 0.70) and the recommendation is M = 4.46 (SD = 0.75). Within the discussion groups, training elements such as the beam and the heatmap were identified as major advantages, helping the acquisition of competencies. Moreover, the possibility to make mistakes without causing any damage, for example, producing workpieces, which are not suitable for customers, was rated as highly relieving. The wearing of an HMD some- times felt uncomfortable, and the visual sharpness should be improved, so that even small mistakes (e.g., slight paint runs) become visible. 5 Discussion This study aimed to investigate whether the VR painting shop, based on the 4C/ID model, can support vocational training in the field of vehicle painting. The results have implications for research and practice, which we discuss in more detail below. Furthermore, we will discuss study limitations. 5.1 Theoretical and Practical Contributions The study demonstrates that the 4C/ID model is a suitable instructional model for design- ing a VR learning application within the vocational training of vehicle painters. This is an important finding, as there is a lack of instructional designs for VR in vocational training (e.g., Mulders et al., 2020). Other studies (Huang et al., 2020) refer to the risk of overloading users when learning with VR. In our study, apprentices perceived the workload as on a manageable level. The calculated mean scores are comparable to or even lower than in similar application scenar- ios (Grier, 2015). We conclude that using the 4C/ID model is an effective way to overcome potential cognitive load issues, as revealed in other studies using VR in educational and training contexts (e.g., Makransky et al., 2019). In terms of duration, learning tasks could even last longer than the learning tasks tested in our study (see Table 1). Also, the usability of the training application was rated highly positively. The behavioral data reveal that maintaining the right angle as well as the proper distance is a large challenge 1 3 M. Mulders et al. for the apprentices. It was striking that the participants maintained both the correct distance and angle less than 50% of the time. This indicates either that these skills are particularly challenging for apprentices or that the VR system may not be tracking them accurately or may contradict real-world skills. In any case, future studies should examine these low scales more closely. Unfortunately, we have no data from other measuring points to compare with to understand the level of difficulty the system implements. Nevertheless, these results con - firm our prior hypothesis that apprentices need additional help to maintain the distance as well as access to a range of varying training tasks. We hypothesized that VR would provide a way to practice skills and competence devel- opment. In the current study, we were not able to find differences regarding the components of competence development: VR seems to support the acquisition of skills, knowledge, and attitudes equally. Skills training, in our case vehicle painting, is often limited in vocational education. There are not enough training opportunities to prepare apprentices for exams or their future daily work. The study results indicate that the VR painting shop can address this educational issue in an appropriate way and could be established as part of the vocational training and, in the long term, also be embedded into the curricula. Therefore, it seems promising to explore the use of the VR painting shop in meaningful large-scale studies. Moreover, it is conceivable that technical solutions developed in this research project can be transferred to further domains of vocational education (e.g., welding). 5.2 Limitations and Future Directions One study limitation is to that it was difficult to integrate the presentation of basic informa - tion and knowledge elements into the VR training application (following the 4C/ID model). Often, text-based information, documents, or time-consuming explanations of the virtual trainer are needed to explain an issue at hand. It might be more helpful to deposit these elements into a desktop application, a mobile app, or simply a paper sheet. Therefore, in further studies, we would recommend considering a design that combines the VR training application with learning materials provided by other means or technologies (e.g., on paper, on-screen). Moreover, with this study as a basis, future studies may investigate the effects of outsourcing some training elements from the 4C/ID model (e.g., explanations of the rela- tionship between temperature and drying times) from the VR application and analyze the blending of these elements. Such an approach may reduce the cognitive load and effort of wearing an HMD and would provide a route for an elaboration of the 4 C/ID model regard- ing the integration of different types of media. The apprentices’ overall evaluation indicates that the VR painting simulator is experi- enced as highly supportive. Information obtained from this study will be incorporated into the final iteration of the VR training application in vocational education. The software for the system will be made available as open-source software. It will be possible and it is planned - with our project partners - to build training facilities at various outlets of interplant training centers in several cities in Germany. With the feedback from this study, the next iteration should be tested with larger numbers, at multiple sites, and over an extended period to obtain a broader set of data that allows for more generalization. In this context, we have to admit that our sample is very small and does not allow generalized statements. There- fore, the results should be considered with caution. Next to larger samples, other research The software and accompanying materials are available as open source at https://github.com/HandLeVR. 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… objectives include monitoring the use of the system longitudinally to determine appren- tices’ ongoing willingness to practice in a VR environment or if the novelty of the system wears off. Moreover, future experimental studies should investigate the manipulation of instructional design parameters (e.g., guidance) as well as learning-related processes (e.g., flow, presence, cognitive load). Next to the beam indicating the proper distance between the spray gun and the workpiece, further support tools could be implemented and tested for their effectivity (e.g., arrows showing the right sequences of painting, acoustic signals showing if the angle is wrong). Another limitation should be mentioned: Most of the data rely on self-reports. Furthermore, results may represent apprentices who were excited and highly motivated to practice virtually in the first place. Future studies should investigate more behavioral data. Moreover, they could focus on the direct translation between painting performance in VR and the application in work tasks in real life. Achievements with the VR painting simulator will not guarantee the same results when painting real cars. Additionally, we used a self-created questionnaire consisting of only three items to measure the acquisi- tion of competencies. In future studies, more validated measurements should be used. In the design of our study, we deliberately considered the inclusion of a control group. However, it is not obvious what condition could or should be used to compare our VR- based training setup. Our implementation is a direct response to the lack of possibilities for practice often encountered in workplace learning environments. Therefore, we would not hesitate to acknowledge that the VR painting simulator will not substitute training in real life with real vehicle pieces. We do address the problem that these training conditions are incredibly scarce (e.g., rare training opportunities, limited support capacity), and even a three-year apprenticeship often does not offer enough training opportunities on the shop floor alone. Similarly, comparing the immersive VR condition with a desktop-based solu - tion with a monitor and a mouse would not provide the necessary environment to develop professional skills: Our VR simulator has to be used standing up, requires the engagement of the full body, and provides an artificially crafted spray gun which is very similar to the real tool. The development of the aspired skill is based on the handling of this tool that needs to be moved in all directions when handling a 3D workpiece, which could not be presented appropriately on a flat screen. Consequently, the VR painting shop provides significantly more opportunities to train the skills needed to apply coating on workpieces. According to the positive evaluation and high scores for usability, apprentices appreciate the VR painting simulator as an otherwise missing possibility to gain these skills. What would be interesting for further inquiry is a comparison of the instructional model of this environment (4C/ID model) with other instructional principles (like offloading instruction from the VR environment and segmenting the use of VR with other media). 6 Conclusion The training of vehicle painting relates to a context that has intrinsic limitations: Training opportunities in vocational education are often too limited to support professional skills acquisition adequately. VR offers a unique solution to overcoming these limitations. In our study, all components of competencies (knowledge, skills, attitudes) were promoted equally in the VR environment. Yet it is noteworthy that, in contrast to skills, knowledge and atti- tudes could also be addressed by other instructional methods and media and, therefore, 1 3 M. Mulders et al. could be offloaded from the VR setup. Based on cost-benefit considerations, it must be decided which instructional methods and media seem favorable for addressing each of the components. All in all, the VR training application evaluated in this study was well received by the apprentices and seems a suitable training environment for vocational education. Usability ratings demonstrate high motivation and, in most cases, eagerness to use this tool for voca- tional practice in the future. Although the current study has some limitations (e.g., small sample, unvalidated questionnaires), it became clear that VR is a promising educational technology in the field of vocational training for skills acquisition. It is important to empha - size that this study was not implemented in the laboratory but within the everyday practice of vehicle painters in a three-year dual education program at a global car manufacturer. The aim was to test the use of the application under typical training conditions with real appren- tices. Hence, as long as real-world training scenarios are rare, VR can provide additional practical training scenarios to strengthen especially skill acquisition. The VR painting shop, which is published as open-source software, can be used (1) to conduct further studies con- tributing to the research field of VR and learning in terms of building VR-specific theories and establishing validated measurements and (2) to support competence acquisition within the educational practice. Authors’ Contributions All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by Mulders. The first draft of the manuscript was written by Mulders and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript. Funding Open Access funding enabled and organized by Projekt DEAL. Declarations Statements and Declarations The study is based on the research project HandLeVR (www.handlevr.de, see footnote 1). HandLeVR was funded by the German Federal Ministry of Education and Research (funding code: 01PV18002B) with partners from the University of Potsdam (computer science), the University of Duisburg-Essen (instructional design), ZWH e.V. (chamber of industry), and Daimler AG Berlin-Ludwigs- felde (international car manufacturer). Conflicts of interest The authors have no relevant financial or non-financial interests to disclose. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. References Allcoat, D., & von Mühlenen, A. (2018). Learning in virtual reality: Effects on performance, emotion and engagement. Research in Learning Technology, 26(0), https://doi.org/10.25304/rlt.v26.2140. 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… Bhagat, K. K., Liou, W. K., & Chang, C. Y. (2016). A cost-effective interactive 3D virtual reality sys - tem applied to military live firing training. Virtual Reality, 20(2), 127–140. https://doi.org/10.1007/ s10055-016-0284-x. Burdea, G., & Coiffet, P. (2006). Virtual reality technology. International Journal of e-Collaboration, 2(1), 61–64. Conges, A., Evain, A., Benaben, F., Chabiron, O., & Rebiere, S. (2020, March). Crisis management exercises in virtual reality. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 87–92). IEEE. https://doi.org/10.1109/VRW50115.2020.00022 Dengel, A., Buchner, J., Mulders, M., & Pirker, J. (2021). Beyond the horizon: Integrating immersive learning environments in the everyday classroom. In 2021 7th International Conference of the Immersive Learn- ing Research Network (iLRN) (pp. 1–5). IEEE. https://doi.org/10.23919/iLRN52045.2021.9459368 Grier, R. A. (2015). How high is high? A meta-analysis of NASA-TLX global workload scores. In Proceed- ings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 59, No. 1, pp. 1727–1731). Sage CA: Los Angeles, CA: SAGE Publications. https://doi.org/10.1177/1541931215591373 Hamilton, D., McKechnie, J., Edgerton, E., & Wilson, C. (2021). Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design. Journal of Computers in Education, 8(1), 1–32. https://doi.org/10.1007/s40692-020-00169-2. Hart, S. G. (2006). NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting (Vol. 50, No. 9, pp. 904–908). Sage CA: Los Angeles, CA: Sage publications. https://doi.org/10.1109/VRW50115.2020.00022 Huang, C. L., Luo, Y. F., Yang, S. C., Lu, C. M., & Chen, A. S. (2020). Influence of students’ learning style, sense of presence, and cognitive load on learning outcomes in an immersive virtual real- ity learning environment. Journal of Educational Computing Research, 58(3), 596–615. https://doi. org/10.1177/0735633119867422. Kester, L., & van Merriënboer, J. J. G. (2021). Implications of the Four Component Instructional Design Model for Multimedia Learning. In R. E. Mayer & L. Fiorella (Eds.), The Cambridge Hand- book of Multimedia Learning (3rd ed., pp. 100–120). Cambridge University Press. https://doi. org/10.1017/9781108894333.011 Kim, K. G., Oertel, C., Dobricki, M., Olsen, J. K., Coppi, A. E., Cattaneo, A., & Dillenbourg, P. (2020). Using immersive virtual reality to support designing skills in vocational education. British Journal of Educational Technology, 51(6), 2199–2213. https://doi.org/10.1111/bjet.13026. Kulpa, R., Multon, F., & Argelaguet, F. (2015). Virtual reality & sport. In 33rd International Conference on Biomechanics in Sports, France, 2015. Jensen, L., & Konradsen, F. (2018). A review of the use of virtual reality head-mounted displays in educa- tion and training. Education and Information Technologies, 23(4), 1515–1529. https://doi.org/10.1007/ s10639-017-9676-0. Lee, E. A. L., Wong, K. W., & Fung, C. C. (2010). How does desktop virtual reality enhance learning out- comes? A structural equation modeling approach. Computers and Education, 55(4), 1424–1442. https:// doi.org/10.1016/j.compedu.2010.06.006. Li, L., Yu, F., Shi, D., Shi, J., Tian, Z., Yang, J., Wang, X., & Jiang, Q. (2017). Application of virtual reality technology in clinical medicine. American journal of translational research, 9(9), 3867. Makransky, G., & Petersen, G. B. (2021). The cognitive affective model of immersive learning (CAMIL): a theoretical research-based model of learning in immersive virtual reality. Educational Psychology Review. https://doi.org/10.1007/s10648-020-09586-2. Makransky, G., Terkildsen, T. S., & Mayer, R. E. (2019). Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learning and Instruction, 60, 225–236. McCloy, R., & Stone, R. (2001). Virtual reality in surgery. Bmj, 323(7318), 912–915. Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: a meta- analysis. Computers & Education, 70, 29–40. https://doi.org/10.1016/j.compedu.2013.07.033. Mikropoulos, T. A., & Natsis, A. (2011). Educational virtual environments: a ten-year review of empiri- cal research (1999–2009). Computers and Education, 56(3), 769–780. https://doi.org/10.1016/j. compedu.2010.10.020. Mulders, M., Buchner, J., & Kerres, M. (2020). A Framework for the use of immersive virtual reality in learning environments. International Journal of Emerging Technologies in Learning (iJET), 15(24), 208–224. https://doi.org/10.3991/ijet.v15i24.16615. Mulders, M. (2020). Investigating learners’ motivation towards a virtual reality learning environment: a pilot study in vehicle painting. In 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) (pp. 390–393). IEEE. https://doi.org/10.1109/AIVR50618.2020.00081 Mulders, M. (2022). Vocational training in virtual reality: a Case Study using the 4 C/ID model. Multimodal Technologies and Interaction, 6(7), 49. https://doi.org/10.3390/mti6070049. 1 3 M. Mulders et al. Van Merriënboer, J. J. (1997). Training complex cognitive skills: a four-component instructional design model for technical training. Englewood Cliffs, NJ: Educational Technology Publications. Van Merriënboer, J. J., Jelsma, O., & Paas, F. G. (1992). Training for reflective expertise: a four-component instructional design model for complex cognitive skills. Educational Technology Research and Devel- opment, 40(2), 23–43. https://doi.org/10.1007/BF02297047. Van Merriënboer, J. J., Clark, R. E., & De Croock, M. B. (2002). Blueprints for complex learning: the 4 C/ ID-model. Educational technology research and development, 50(2), 39–61. Van Merriënboer, J. J., & Kirschner, P. A. (2017). Ten Steps to Complex Learning: A Systematic Approach to Four-Component Instructional Design (3rd ed.). Routledge. https://doi.org/10.4324/9781315113210 Radianti, J., Majchrzak, T. A., Fromm, J., & Wohlgenannt, I. (2020). A systematic review of immersive virtual reality applications for higher education: design elements, lessons learned, and research agenda. Computers & Education, 147, 103778. https://doi.org/10.1016/j.compedu.2019.103778. Sacks, R., Perlman, A., & Barak, R. (2013). Construction safety training using immersive virtual reality. Construction Management and Economics, 31(9), 1005–1017. https://doi.org/10.1080/01446193.201 3.828844. Schrepp, M. (2015). User experience questionnaire handbook. https://doi.org/10.13140/RG.2.1.2815.0245 Slater, M., Khanna, P., Mortensen, J., & Yu, I. (2009). Visual realism enhances realistic response in an immer- sive virtual environment. IEEE computer graphics and applications, 29(3), 76–84. Slater, M., & Sanchez-Vives, M. V. (2016). Enhancing our lives with immersive virtual reality. Frontiers in Robotics and AI, 3, 74. https://doi.org/10.3389/frobt.2016.00074. Smith, S. P., & Burd, E. L. (2019). Response activation and inhibition after exposure to virtual reality. Array, 3, 100010. https://doi.org/10.1016/j.array.2019.100010. Stone, R. T., McLaurin, E., Zhong, P., & Watts, K. P. (2013). Full virtual reality vs. integrated virtual reality training in welding. Welding Journal, 92(6), 167. Xie, Q. (2021). Applying vocational education and training pedagogy in business English courses for China’s English major undergraduates. Emerald, 65(2), 292–312. Zender, R., Sander, P., Weise, M., Mulders, M., Lucke, U., & Kerres, M. (2019). HandLeVR: Action-Ori- ented Learning in a VR Painting Simulator. In International Symposium on Emerging Technologies for Education (pp. 46–51). Springer, Cham. Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. Authors and Affiliations 1 2 1 Miriam  Mulders  · Josef  Buchner  · Michael  Kerres Miriam Mulders miriam.mulders@uni-duisburg-essen.de Josef Buchner josef.buchner@phsg.ch Michael Kerres michael.kerres@uni-duisburg-essen.de Chair of Educational Technology and Instructional Design, University of Duisburg-Essen, Universitätsstraße 2, 45127 Essen, Germany St. Gallen University of Teacher Education, Müller-Friedbergstraße 34, 9400 Rorschach, Switzerland 1 3 http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png "Technology, Knowledge and Learning" Springer Journals

Virtual Reality in Vocational Training: A Study Demonstrating the Potential of a VR-based Vehicle Painting Simulator for Skills Acquisition in Apprenticeship Training

Download PDF
16 pages

Loading next page...
 
/lp/springer-journals/virtual-reality-in-vocational-training-a-study-demonstrating-the-u5A2CI0PvS

References (40)

Publisher
Springer Journals
Copyright
Copyright © The Author(s) 2022
ISSN
2211-1662
eISSN
2211-1670
DOI
10.1007/s10758-022-09630-w
Publisher site
See Article on Publisher Site

Abstract

Previous studies on Virtual Reality (VR)-enriched learning pointed out the advantages of immersive learning for the development of competencies. In the context of vocational education in vehicle painting, training opportunities are severely limited for many reasons. VR can be utilized to develop a comprehensive learning environment with authentic train- ing tasks. Besides the need to train psychomotor skills, vehicle painting procedures are complex tasks requiring incremental training to develop knowledge, skills, and attitudes. This study aims to evaluate a VR training application for vehicle painting, focusing on the development of professional competencies regarding skills, knowledge, and attitudes. 47 apprentices participated in the evaluation study. A VR-simulated painting booth was developed based on the 4 C/ID model by van Merriënboer, where they dealt with typical painting jobs on 3D workpieces (e.g., car wings, engine hood). Within the descriptive-inferential study, no significant differences between the types of competencies were revealed. The training application supports the acquisition of skills, knowledge, and attitudes equally. Further results regarding usability, cognitive load, etc., are promising. The essential finding of this study is that the VR training application is generally suit - able for supporting craftsmanship within the field of vehicle painting. Since training op - portunities for apprentices in this context are often rare, VR offers a unique solution especially for skills training if it follows a proven instructional model for the development of competencies. Keywords Virtual Reality · 4C/ID model · Competence development · Skills acquisition · Vocational education · Apprenticeship training Extended author information available on the last page of the article 1 3 M. Mulders et al. 1 Introduction Virtual Reality (VR) has been widely adopted in various domains within vocational edu- cation (Allcoat & van Mühlenen, 2018; Hamilton et al., 2021; Merchant et al., 2014; Mikropoulos & Natsis, 2011), including surgery (McCloy & Stone, 2001), construction management (Sacks, Perlman, & Barak, 2013), weld training (Stone et al., 2013), and mili- tary training (Bhagat et al., 2016), as a way to engage and motivate learners, decrease time to achieve skill mastery, cut down on material usage, and improve performance outcomes. The technology has been applied for training a wide range of real-world tasks and procedures. It is of note that VR technologies seem to be particularly suited for training psychomotor skills and have limited benefits for the acquisition of declarative knowledge (e.g., Jensen & Konradsen, 2018; Makransky & Petersen, 2021; Xie, 2021). Traditional training methods are often not sufficient to support vocational skills acquisition adequately. In general, real- world vocational skills training has the following limitations: (1) it might be expensive due to the cost of preparing real-world training materials and hiring human coaches, (2) it might consume time and effort to set up the real-world training, (3) it might be counterintuitive and unappealing due to the lack of visual aids such as 3D animations, and (4) it might not be possible to train some skills in the real world (e.g., emergency procedures) that can only be safely trained in simulators. Depending on the domain, VR could reduce the costs of vocational skills training while increasing the number of learning opportunities and training cycles. Moreover, as VR learning scenarios mainly involve computer-generated 3D graph- ics, VR developers can easily create a variety of scenarios from existing 3D assets. These simulated scenarios can be applied for the training of learners with different prerequisites (at the beginning of the training vs. immediately before the final exam). Besides, VR applica - tions allow learning in the comfort of a more personal spaces. This is especially important for cases where an apprentice might feel uncomfortable about their actions in a real-world training environment due to the presence of a trainer. Moreover, VR training provides a safe environment with minimal exposure to dangerous situations and no danger to dam- age expensive tools and machinery (Conges et al., 2020; Li et al., 2017). Altogether, VR technology has become popular in recent years and its effectiveness for vocational train - ing has been demonstrated (e.g., Xie, 2021). Thus, VR offers a unique solution to address various shortcomings in the development of vocational skills. The technology seems to be predestined to support skills training, whereas the training of knowledge and attitudes may be further addressed by other instructional methods in the real world. However, the impact of VR on various dimensions of learning in the different fields of education needs further research and evaluation (Kim et al., 2020). Generally, apprentices in various vocational settings are often inexperienced, not able to carry out vocational tasks by themselves, and hence, less confident. Here, VR can provide many training opportunities with the possibil - ity to repeat specific aspects several times. Thus, apprentices gain training experience and become more confident before applying skills in real-world scenarios. This means that VR learning environments are not perceived as a substitute for real-world training, but they can prepare apprentices adequately and can be added to real-world training to improve and accelerate mastery efficiently. Xie (2021) comprehensively reviewed a set of VR skills trainings and distinguished between the following domains: first responder training, medical training, military training, transportation, workforce training, and interpersonal skills training. 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… Our following study is situated in the context of workforce training and there, in the field of vehicle painting. In this field of vocational education, authentic artifacts for training are often rare. Vehicle painters must operate effectively in a complex environment. Often, how - ever, they have surprisingly limited opportunities to practice procedures before applying them on real workpieces from cars (e.g., Zender et al., 2019). In the field of vehicle painting, various methods and techniques of applying a coat to a workpiece under differing conditions must be trained thoroughly. For example, new part paintings as well as spot repair painting, which means painting over a small, damaged spot on the car, have to be done. However, frequent and repeated training of these skills is hampered by economic (e.g., material costs), physical (e.g., environmentally sensitive materials), and social factors (e.g., limited support capacity). Skills training in vehicle painting typically relies heavily on memorization and routiniza- tion of procedural steps from criterion-based checklists. However, since apprentices often have limited opportunities to practice, they struggle to build routines for these procedures. VR can offer a unique and sophisticated solution to address this training problem. In a VR simulator, learners are placed in a realistic 3-dimensional environment (here: a paint booth), where they can safely practice without causing any harm, such as producing workpieces, which are not suitable for customers due to mistakes in production, or wasting paint. Additionally, apprentices are highly motivated and engaged in environments that use novel and appealing technologies such as VR (e.g., Mulders 2020). Vehicle painting seems to be a particularly interesting field for the application of VR. Psychomotor tasks are typically trained in repetition loops to strengthen the routine of skills. Moreover, haptic feedback from 3D workpieces is not required here, as these are not touched during the application. Instead of commercial controllers, a highly authentic spray gun (from 3D printing) can be provided, which facilitates transfer to practice. Additionally, feedback on the quality of the coating, for example, regarding layer thickness, can be pro- vided immediately, whereas in the real world, it takes several hours until coatings are dried and results become visible and assessable. In the next sections, we provide further details on the theoretical background of VR in vocational training and our methodological approach to analyzing the effects on the acquisi - tion of competencies. Then, we present the results of our study. Finally, we discuss these results regarding the perspectives of VR in vocational education. The article closes with limitations, an outlook for future research, and a conclusion. 2 Background VR is an emerging technology using computer-generated graphics to produce a realistic 3D environment for multiple sensory experiences (Burdea & Coiffet, 2006) including a tracking system (input) and a display system (output) (Kulpa et al., 2015). The user is fully immersed in a computer-generated world. Their viewpoint changes according to head movements (Slater et al., 2009; Slater & Sanchez-Vives, 2016). There are several elements of VR expe- riences, distinguished roughly by the degree to which the user’s sensory perception is co- opted. HMDs with headphones, wearable haptic clothing, and other equipment that allows the user to walk freely exemplify the most common consumer-grade VR setups. VR is not 1 3 M. Mulders et al. limited to visual information, as the auditory, haptic, kinesthetic, and olfactory senses can also be technologically simulated. While recent research has promoted technologically advanced VR learning environ- ments, it has often been questioned if and how VR can be transferred from laboratory set- tings to everyday learning in schools and other educational environments (Dengel et al., 2021). There is a need to demonstrate and evaluate VR applications for training in real (accredited) curricula and formal education. In addition, many VR applications have been developed without substantial reference to instructional methods or research on learning with digital technology, seemingly reducing the acquisition of competence to a mode of “trial & error” (Mulders et al., 2020). Therefore, we developed an approach that is situated in vocational education and a train- ing environment based on the three-year apprenticeship curriculum for vehicle painting that is nationally accredited in Germany . The learning application is based on the four- component instructional design (4 C/ID) model, which has been successfully applied and evaluated in various contexts and domains (e.g., Kester & van Merriënboer 2021; van Mer- riënboer, Jelsma, & Paas, 1992; van Merriënboer, Clark, & de Croock, 2002; van Merriën- boer & Kirschner 2017). The 4C/ID model is a framework for developing instruction on complex tasks including skills development. To our knowledge, the 4C/ID model has not been applied to other VR trainings so far. Thus, we seek to develop a meaningful training application aligned to the principles of the 4 C/ID model. Here, competencies are defined as complex cognitive skills, consisting of integrated sets of constituent skills with their under- lying knowledge structures and attitudes (van Merriënboer, 1997). A detailed description of how we applied the 4 C/ID models principles to VR and the vocational field of vehicle painting can be found in Mulders (2022) and Zender et al. (2019). Previous studies on VR-enriched training pointed out its advantages for the acquisition of skills, but vehicle painting procedures are complex tasks requiring the training of whole tasks including all components of competencies (i.e., skills, knowledge, attitudes). Also, practitioners asked for the integration of the various relevant components in the VR applica- tion (e.g., knowing how to prepare workpieces, attitudes towards personal protective equip- ment) to fulfill a customer order successfully, and not only the training of motor skills to apply the coat. Therefore, we have developed a comprehensive learning application with authentic train- ing tasks for the field of vehicle painting using VR that addresses the integrated acquisi - tion of all components of competencies: skills, knowledge, and attitudes. Still, the question remains if the virtual environment fosters competence acquisition sufficiently. For example, presenting textual information in VR is somehow challenging. In vehicle painting, work plans, technical datasheets, etc., are often text-based and wordy and might be difficult to grasp when presented in the VR environment. Our study aims to evaluate the VR training application with an instructional approach based on the 4C/ID model. We investigated if the VR training application is generally usable and suited to supporting competence acquisition for apprentices in the domain of vehicle painting. https://www.bibb.de/dienst/berufesuche/de/index_berufesuche.php/profile/apprenticeship/67867684 . 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… Fig. 1 Apprentice learning with the VR-based painting simulator 3 Methods The VR system used in this study was developed during a 38-month research project. The project was conducted by representatives from different disciplines, such as computer sci - entists and instructional designers. Within the project, all training elements were developed from scratch. The 3D environment and its components were programmed with Unity. To develop an instructional design, several interviews with practical partners were conducted and curricula were studied. The result of the project is the VR painting simulator, which consists of several task classes (e.g., repair painting) and corresponding learning tasks. Pre- requisites of use for the VR painting simulator are a gaming computer and a connected head-mounted display (HMD; here: HTC Vive), a pressure tube, as well as one commer- cial controller onto which a 3D-printed spray gun is mounted (see Fig. 1). Moreover, an additional authoring tool allows teachers to design their tasks and assign these to certain apprentices. At the end of the project, we tested the training tool with apprentices in vehicle painting who should use the tool prospectively to practice skills repeatedly with immediate and consistent feedback. The available VR training includes a suitable variation and pro- gression of learning tasks, which can be adapted by a trainer based on a defined number of parameters (e.g., type of workpiece, number of coatings) and in terms of complexity. With this feature, variations of learning tasks can be designed similarly to different customer orders (e.g., Mulders, 2022). In the VR training application, apprentices work on various learning tasks, which are all designed as typical customer orders. To do this, the training is situated in a simulated The HandLeVR research project (01.01.19–28.02.22; funding code: 01PV18002B) is funded by the German Federal Ministry of Education and Research with partners from the University of Potsdam (computer sci- ence), the University of Duisburg-Essen (instructional design), ZWH e.V. (chamber of industry), and Daimler AG Berlin-Ludwigsfelde (international car manufacturer). A total of 35.6 person-months was necessary for the technical development of the VR training application (tasks such as project coordination, transfer, evalua- tion, etc., excluded). The software and accompanying materials are available as open source at https://github. com/HandLeVR. https://unity.com/de. 1 3 M. Mulders et al. paint booth that contains a workpiece to be painted as a 3D model (e.g., an engine hood). Before and after the painting process, apprentices are equipped with the requisite knowl- edge and attitudes. A virtual trainer, instructional videos, as well as multiple choice and sorting tasks provide relevant information. During the painting process, the apprentices’ performance regarding several parameters (e.g., paint consumption, distance to the work- piece) is recorded and stored. After each task, the apprentice is informed about their results and achievements. They receive visual feedback, e.g., by illustrating layer thickness on a heatmap on the workpiece. Different colors indicate layer thickness (detailed description in Mulders (2022) and Zender et al., (2019)). The learning environment consists of a progres- sion of learning tasks with different training instructions and supporting information follow - ing the principles of the 4C/ID model. The presented research investigates the overall effectiveness of a VR learning applica - tion in the vocational field of vehicle painting. One concern relevant to learning in VR environments is the cognitive load experienced when using VR (Makransky & Petersen, 2021). Makransky, Terkildsen, and Mayer (2019) as well as Huang and colleagues (2020) showed that learning in VR may overload and distract learners, resulting in poorer learn- ing outcomes. Usability was identified as another decisive factor towards learning in VR. Usability refers to the quality and accessibility of the technology in use and is assumed to impact learning processes in VR (Lee et al., 2010; Radianti et al., 2020). Another research interest focuses on learning in VR regarding the competence to be acquired. As Jensen and Konradsen (2018) as well as Makransky and Petersen (2021) mentioned, VR seems to be particularly suited for training psychomotor skills and has limited benefits for knowledge acquisition. To investigate learning processes within the VR painting simulation in terms of com- petence acquisition, we conducted an evaluative single-group study with post-tests and behavioral assessments. In the following sections, we outline the methods of our descrip- tive-inferential study in detail. 3.1 Sample and Context A total of 47 apprentices in vehicle painting (11 female) participated in the study: 16 from Daimler AG, an international car manufacturer, and 31 from other national training institu- tions. Their age varies between 17 and 37 (M = 20.91, SD = 3.65). The study took place as part of their 3-year apprenticeship. 3.2 VR Painting Simulator Following the 4C/ID model, the VR painting simulator includes a set of learning tasks that differ regarding various parameters (e.g., type of workpiece) as well as in terms of com - plexity (van Merriénboer & Kirschner, 2017). It intends to help apprentices achieve the overarching goal of vocational action competence. In the VR application, apprentices work on learning tasks. Prototypical learning tasks were developed according to the 4C/ID model of competence development (van Merriënboer et al., 2002). This was done in cooperation with experienced corporate trainers and apprentices in the field of vehicle painting. The tasks have been evaluated and re-developed iteratively through several design cycles. For example, one learning task illustrates a single-layer refinishing on an engine hood. To work 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… Fig. 2 The paint booth Fig. 3 The virtual monitor on a learning task, the apprentices immerse in a paint booth that has been recreated in detail and contains a 3D workpiece clamped on a painting stand (see Fig. 2). Moreover, there is a (virtual) monitor (see Fig. 3) in the 3D environment and a poster to test the spray pattern. In their dominant hand, the apprentice holds a spray gun produced from a 3D printer (see Fig. 3). In the 3D environment, a virtual trainer (presented as an avatar) is permanently present, guiding the apprentice through the task and providing feedback at certain steps (see Fig. 3). In addition to the painting process itself, the environment contains supportive information, mostly for preparatory and follow-up activities, and part-task training follow- ing the 4C/ID model (e.g., self-made videos by apprentices about using personal protective equipment). During the painting process, the apprentice is supported by a beam indicating the proper distance to a workpiece (see Fig. 5) and by supportive oral and written feedback from the virtual trainer. The feedback system is adaptive, depending on the learner’s perfor- mance and level of expertise. For example, for beginners, elaborate explanations regarding 1 3 M. Mulders et al. Fig. 4 The 3D printed spray gun Fig. 5 The beam indicating the proper distance to the workpiece the distance to the workpiece and its implication on the paint amount are given, whereas experienced learners are prompted with visual stimuli signaling that they are too close or 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… Table 1 NASA-TLX results subscale M SD mental demand 47.17 25.33 physical demand 46.05 28.09 temporal demand 17.50 18.85 effort 35.09 24.98 frustration 25.66 28.00 too far away from the workpiece. During coat application, the performance is recorded and stored along with a variety of parameters (e.g., layer thickness) and can be replayed for reflection and further discussions with a (real) instructor or supervisor. A learning task closes with feedback based on several parameters (e.g., wasted coat) and feedback on the quality of the application (i.e., heatmap). 3.3 Instruments This descriptive-inferential evaluation study generates data from (1) questionnaires and (2) behavioral tracking. Demographic data, previous experiences with VR technology, and aversive impressions within VR were captured by several closed-ended single- and multi- ple-choice questions. Moreover, validated as well as self-created questionnaires were used during the evaluation study. Validated questionnaires: The subjective cognitive load experienced within VR was tested by the NASA-TLX (Hart, 2006; α = 0.68 to α = 0.74). The questionnaire temporal demand frustration is based on six subscales (see Table 1, e.g., temporal demand) which are rated within a 100-points range (e.g., How mentally demanding was the task?). The overall usability of the VR painting application was measured by the User Experience Questionnaire (UEQ; Schrepp 2015; α = 0.72 to α = 0.77). Pairs of opposites (e.g., attractive - unat- attractiveness novelty tractive) were graded on a seven-point Likert scale resulting in six subscales (e.g., novelty). Self-created questionnaires: Furthermore, apprentices were asked to what extent the learning tasks contributed to the acquisition of competencies, i.e., knowledge, skills, and attitudes, to test if there are differences between the types of competency gains (e.g., The learning task has helped me know more about new part painting.). The scale ranges from 1 (absolutely disagree) to 5 (fully agree). The internal consistency ranges from α = 0.70 knowledge to α = 0.74. Based on the identical scale, apprentices were asked if the application is sat- skills isfying (α = 0.71) and recommendable (α = 0.77). Further data: In addition to data from questionnaires, the VR system itself provided data. Success criteria (e.g., layer thickness, angle) could, thus, flow into the evaluation. 3.4 Procedure On completion of the second iteration of the system, we tested two prototypical learning tasks of the VR training application. The study took place in several training centers within Germany. For this, researchers and apprentices came together in several one-day work- shops. First, apprentices watched a video tutorial explaining how to navigate, and select and apply paint within VR. After the HMD and the spray gun were adjusted, the apprentices spent some minutes without any action to become comfortable with the new situation. Then, they worked on two different tasks both illustrating single-layer coating. The apprentices 1 3 M. Mulders et al. Fig. 6 The beam indicating the proper distance to the workpiece performed alone and independently without external help (see Fig. 1). The test administra- tors followed a guideline to keep the test conditions as uniform as possible. They made sure that the maximum duration of headset use did not exceed 30 min (Smith & Burd, 2019). Subsequently, each apprentice filled in questionnaires (approximately 35 min) and took part in a discussion group (approximately 45 to 60 min). 3.5 Data Evaluation We decided to provide means and standard deviations as well as t-tests to check if there are significant differences between the acquisition of skills, attitudes, and knowledge. We checked normality of the sample for the tested variables by Shapiro-Wilk-Tests (p > .05). 4 Results In this section, we outline the results of our study. For 75% of the apprentices, the first language is German, others named Armenian or Turkish. Half of the participants (49%) reported having previous experience with VR, but in almost all cases extremely rarely. Par- ticipants were asked about unpleasant experiences. In a few cases, they reported difficulties with seeing sharply, disorientation, or general discomfort. To answer our research question whether the VR training application is generally usable and suitable for supporting competence acquisition within the vocational training of vehicle painters, we gained several data. First, the subjective cognitive load was surveyed by NASA-TLX (Hart, 2006). The apprentices reported an overall workload of M = 31.09 (SD = 25.05). Further data are pro- vided in Table 1. Second, apprentices rated the usability of the VR painting application based on the UEQ (Schrepp, 2015). The results are visualized in Fig. 6. 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… Table 2 Competencies results subscale M SD knowledge 3.17 0.79 skills 3.21 0.86 attitudes 3.45 0.86 Third, we gained data from behavioral tracking. These data revealed how difficult it was to maintain the correct distance as well as the correct angle to a workpiece. The correct dis- tance was maintained 49,54%, and the correct angle 45,43% of the time. Fourth, we questioned to what extent the learning tasks contributed to the acquisition of competencies. From these ratings, it can be concluded that the learning tasks support the acquisition of skills, knowledge, and attitudes satisfactorily (see Table 2). Paired t-tests revealed no significant differences between types of competencies, whether between knowl - edge and skills (t(46) = − 0.34, p = .74, n.s.), knowledge and attitudes (t(46) = 2.45, p = .08, n.s.), or skills and attitudes (t(46) = 2.20, p = .11, n.s.). Finally, apprentices were asked to give an overall rating of their experience. The con- tentment is M = 4.30 (SD = 0.70) and the recommendation is M = 4.46 (SD = 0.75). Within the discussion groups, training elements such as the beam and the heatmap were identified as major advantages, helping the acquisition of competencies. Moreover, the possibility to make mistakes without causing any damage, for example, producing workpieces, which are not suitable for customers, was rated as highly relieving. The wearing of an HMD some- times felt uncomfortable, and the visual sharpness should be improved, so that even small mistakes (e.g., slight paint runs) become visible. 5 Discussion This study aimed to investigate whether the VR painting shop, based on the 4C/ID model, can support vocational training in the field of vehicle painting. The results have implications for research and practice, which we discuss in more detail below. Furthermore, we will discuss study limitations. 5.1 Theoretical and Practical Contributions The study demonstrates that the 4C/ID model is a suitable instructional model for design- ing a VR learning application within the vocational training of vehicle painters. This is an important finding, as there is a lack of instructional designs for VR in vocational training (e.g., Mulders et al., 2020). Other studies (Huang et al., 2020) refer to the risk of overloading users when learning with VR. In our study, apprentices perceived the workload as on a manageable level. The calculated mean scores are comparable to or even lower than in similar application scenar- ios (Grier, 2015). We conclude that using the 4C/ID model is an effective way to overcome potential cognitive load issues, as revealed in other studies using VR in educational and training contexts (e.g., Makransky et al., 2019). In terms of duration, learning tasks could even last longer than the learning tasks tested in our study (see Table 1). Also, the usability of the training application was rated highly positively. The behavioral data reveal that maintaining the right angle as well as the proper distance is a large challenge 1 3 M. Mulders et al. for the apprentices. It was striking that the participants maintained both the correct distance and angle less than 50% of the time. This indicates either that these skills are particularly challenging for apprentices or that the VR system may not be tracking them accurately or may contradict real-world skills. In any case, future studies should examine these low scales more closely. Unfortunately, we have no data from other measuring points to compare with to understand the level of difficulty the system implements. Nevertheless, these results con - firm our prior hypothesis that apprentices need additional help to maintain the distance as well as access to a range of varying training tasks. We hypothesized that VR would provide a way to practice skills and competence devel- opment. In the current study, we were not able to find differences regarding the components of competence development: VR seems to support the acquisition of skills, knowledge, and attitudes equally. Skills training, in our case vehicle painting, is often limited in vocational education. There are not enough training opportunities to prepare apprentices for exams or their future daily work. The study results indicate that the VR painting shop can address this educational issue in an appropriate way and could be established as part of the vocational training and, in the long term, also be embedded into the curricula. Therefore, it seems promising to explore the use of the VR painting shop in meaningful large-scale studies. Moreover, it is conceivable that technical solutions developed in this research project can be transferred to further domains of vocational education (e.g., welding). 5.2 Limitations and Future Directions One study limitation is to that it was difficult to integrate the presentation of basic informa - tion and knowledge elements into the VR training application (following the 4C/ID model). Often, text-based information, documents, or time-consuming explanations of the virtual trainer are needed to explain an issue at hand. It might be more helpful to deposit these elements into a desktop application, a mobile app, or simply a paper sheet. Therefore, in further studies, we would recommend considering a design that combines the VR training application with learning materials provided by other means or technologies (e.g., on paper, on-screen). Moreover, with this study as a basis, future studies may investigate the effects of outsourcing some training elements from the 4C/ID model (e.g., explanations of the rela- tionship between temperature and drying times) from the VR application and analyze the blending of these elements. Such an approach may reduce the cognitive load and effort of wearing an HMD and would provide a route for an elaboration of the 4 C/ID model regard- ing the integration of different types of media. The apprentices’ overall evaluation indicates that the VR painting simulator is experi- enced as highly supportive. Information obtained from this study will be incorporated into the final iteration of the VR training application in vocational education. The software for the system will be made available as open-source software. It will be possible and it is planned - with our project partners - to build training facilities at various outlets of interplant training centers in several cities in Germany. With the feedback from this study, the next iteration should be tested with larger numbers, at multiple sites, and over an extended period to obtain a broader set of data that allows for more generalization. In this context, we have to admit that our sample is very small and does not allow generalized statements. There- fore, the results should be considered with caution. Next to larger samples, other research The software and accompanying materials are available as open source at https://github.com/HandLeVR. 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… objectives include monitoring the use of the system longitudinally to determine appren- tices’ ongoing willingness to practice in a VR environment or if the novelty of the system wears off. Moreover, future experimental studies should investigate the manipulation of instructional design parameters (e.g., guidance) as well as learning-related processes (e.g., flow, presence, cognitive load). Next to the beam indicating the proper distance between the spray gun and the workpiece, further support tools could be implemented and tested for their effectivity (e.g., arrows showing the right sequences of painting, acoustic signals showing if the angle is wrong). Another limitation should be mentioned: Most of the data rely on self-reports. Furthermore, results may represent apprentices who were excited and highly motivated to practice virtually in the first place. Future studies should investigate more behavioral data. Moreover, they could focus on the direct translation between painting performance in VR and the application in work tasks in real life. Achievements with the VR painting simulator will not guarantee the same results when painting real cars. Additionally, we used a self-created questionnaire consisting of only three items to measure the acquisi- tion of competencies. In future studies, more validated measurements should be used. In the design of our study, we deliberately considered the inclusion of a control group. However, it is not obvious what condition could or should be used to compare our VR- based training setup. Our implementation is a direct response to the lack of possibilities for practice often encountered in workplace learning environments. Therefore, we would not hesitate to acknowledge that the VR painting simulator will not substitute training in real life with real vehicle pieces. We do address the problem that these training conditions are incredibly scarce (e.g., rare training opportunities, limited support capacity), and even a three-year apprenticeship often does not offer enough training opportunities on the shop floor alone. Similarly, comparing the immersive VR condition with a desktop-based solu - tion with a monitor and a mouse would not provide the necessary environment to develop professional skills: Our VR simulator has to be used standing up, requires the engagement of the full body, and provides an artificially crafted spray gun which is very similar to the real tool. The development of the aspired skill is based on the handling of this tool that needs to be moved in all directions when handling a 3D workpiece, which could not be presented appropriately on a flat screen. Consequently, the VR painting shop provides significantly more opportunities to train the skills needed to apply coating on workpieces. According to the positive evaluation and high scores for usability, apprentices appreciate the VR painting simulator as an otherwise missing possibility to gain these skills. What would be interesting for further inquiry is a comparison of the instructional model of this environment (4C/ID model) with other instructional principles (like offloading instruction from the VR environment and segmenting the use of VR with other media). 6 Conclusion The training of vehicle painting relates to a context that has intrinsic limitations: Training opportunities in vocational education are often too limited to support professional skills acquisition adequately. VR offers a unique solution to overcoming these limitations. In our study, all components of competencies (knowledge, skills, attitudes) were promoted equally in the VR environment. Yet it is noteworthy that, in contrast to skills, knowledge and atti- tudes could also be addressed by other instructional methods and media and, therefore, 1 3 M. Mulders et al. could be offloaded from the VR setup. Based on cost-benefit considerations, it must be decided which instructional methods and media seem favorable for addressing each of the components. All in all, the VR training application evaluated in this study was well received by the apprentices and seems a suitable training environment for vocational education. Usability ratings demonstrate high motivation and, in most cases, eagerness to use this tool for voca- tional practice in the future. Although the current study has some limitations (e.g., small sample, unvalidated questionnaires), it became clear that VR is a promising educational technology in the field of vocational training for skills acquisition. It is important to empha - size that this study was not implemented in the laboratory but within the everyday practice of vehicle painters in a three-year dual education program at a global car manufacturer. The aim was to test the use of the application under typical training conditions with real appren- tices. Hence, as long as real-world training scenarios are rare, VR can provide additional practical training scenarios to strengthen especially skill acquisition. The VR painting shop, which is published as open-source software, can be used (1) to conduct further studies con- tributing to the research field of VR and learning in terms of building VR-specific theories and establishing validated measurements and (2) to support competence acquisition within the educational practice. Authors’ Contributions All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by Mulders. The first draft of the manuscript was written by Mulders and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript. Funding Open Access funding enabled and organized by Projekt DEAL. Declarations Statements and Declarations The study is based on the research project HandLeVR (www.handlevr.de, see footnote 1). HandLeVR was funded by the German Federal Ministry of Education and Research (funding code: 01PV18002B) with partners from the University of Potsdam (computer science), the University of Duisburg-Essen (instructional design), ZWH e.V. (chamber of industry), and Daimler AG Berlin-Ludwigs- felde (international car manufacturer). Conflicts of interest The authors have no relevant financial or non-financial interests to disclose. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. References Allcoat, D., & von Mühlenen, A. (2018). Learning in virtual reality: Effects on performance, emotion and engagement. Research in Learning Technology, 26(0), https://doi.org/10.25304/rlt.v26.2140. 1 3 Virtual Reality in Vocational Training: A Study Demonstrating the… Bhagat, K. K., Liou, W. K., & Chang, C. Y. (2016). A cost-effective interactive 3D virtual reality sys - tem applied to military live firing training. Virtual Reality, 20(2), 127–140. https://doi.org/10.1007/ s10055-016-0284-x. Burdea, G., & Coiffet, P. (2006). Virtual reality technology. International Journal of e-Collaboration, 2(1), 61–64. Conges, A., Evain, A., Benaben, F., Chabiron, O., & Rebiere, S. (2020, March). Crisis management exercises in virtual reality. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 87–92). IEEE. https://doi.org/10.1109/VRW50115.2020.00022 Dengel, A., Buchner, J., Mulders, M., & Pirker, J. (2021). Beyond the horizon: Integrating immersive learning environments in the everyday classroom. In 2021 7th International Conference of the Immersive Learn- ing Research Network (iLRN) (pp. 1–5). IEEE. https://doi.org/10.23919/iLRN52045.2021.9459368 Grier, R. A. (2015). How high is high? A meta-analysis of NASA-TLX global workload scores. In Proceed- ings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 59, No. 1, pp. 1727–1731). Sage CA: Los Angeles, CA: SAGE Publications. https://doi.org/10.1177/1541931215591373 Hamilton, D., McKechnie, J., Edgerton, E., & Wilson, C. (2021). Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design. Journal of Computers in Education, 8(1), 1–32. https://doi.org/10.1007/s40692-020-00169-2. Hart, S. G. (2006). NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting (Vol. 50, No. 9, pp. 904–908). Sage CA: Los Angeles, CA: Sage publications. https://doi.org/10.1109/VRW50115.2020.00022 Huang, C. L., Luo, Y. F., Yang, S. C., Lu, C. M., & Chen, A. S. (2020). Influence of students’ learning style, sense of presence, and cognitive load on learning outcomes in an immersive virtual real- ity learning environment. Journal of Educational Computing Research, 58(3), 596–615. https://doi. org/10.1177/0735633119867422. Kester, L., & van Merriënboer, J. J. G. (2021). Implications of the Four Component Instructional Design Model for Multimedia Learning. In R. E. Mayer & L. Fiorella (Eds.), The Cambridge Hand- book of Multimedia Learning (3rd ed., pp. 100–120). Cambridge University Press. https://doi. org/10.1017/9781108894333.011 Kim, K. G., Oertel, C., Dobricki, M., Olsen, J. K., Coppi, A. E., Cattaneo, A., & Dillenbourg, P. (2020). Using immersive virtual reality to support designing skills in vocational education. British Journal of Educational Technology, 51(6), 2199–2213. https://doi.org/10.1111/bjet.13026. Kulpa, R., Multon, F., & Argelaguet, F. (2015). Virtual reality & sport. In 33rd International Conference on Biomechanics in Sports, France, 2015. Jensen, L., & Konradsen, F. (2018). A review of the use of virtual reality head-mounted displays in educa- tion and training. Education and Information Technologies, 23(4), 1515–1529. https://doi.org/10.1007/ s10639-017-9676-0. Lee, E. A. L., Wong, K. W., & Fung, C. C. (2010). How does desktop virtual reality enhance learning out- comes? A structural equation modeling approach. Computers and Education, 55(4), 1424–1442. https:// doi.org/10.1016/j.compedu.2010.06.006. Li, L., Yu, F., Shi, D., Shi, J., Tian, Z., Yang, J., Wang, X., & Jiang, Q. (2017). Application of virtual reality technology in clinical medicine. American journal of translational research, 9(9), 3867. Makransky, G., & Petersen, G. B. (2021). The cognitive affective model of immersive learning (CAMIL): a theoretical research-based model of learning in immersive virtual reality. Educational Psychology Review. https://doi.org/10.1007/s10648-020-09586-2. Makransky, G., Terkildsen, T. S., & Mayer, R. E. (2019). Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learning and Instruction, 60, 225–236. McCloy, R., & Stone, R. (2001). Virtual reality in surgery. Bmj, 323(7318), 912–915. Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: a meta- analysis. Computers & Education, 70, 29–40. https://doi.org/10.1016/j.compedu.2013.07.033. Mikropoulos, T. A., & Natsis, A. (2011). Educational virtual environments: a ten-year review of empiri- cal research (1999–2009). Computers and Education, 56(3), 769–780. https://doi.org/10.1016/j. compedu.2010.10.020. Mulders, M., Buchner, J., & Kerres, M. (2020). A Framework for the use of immersive virtual reality in learning environments. International Journal of Emerging Technologies in Learning (iJET), 15(24), 208–224. https://doi.org/10.3991/ijet.v15i24.16615. Mulders, M. (2020). Investigating learners’ motivation towards a virtual reality learning environment: a pilot study in vehicle painting. In 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) (pp. 390–393). IEEE. https://doi.org/10.1109/AIVR50618.2020.00081 Mulders, M. (2022). Vocational training in virtual reality: a Case Study using the 4 C/ID model. Multimodal Technologies and Interaction, 6(7), 49. https://doi.org/10.3390/mti6070049. 1 3 M. Mulders et al. Van Merriënboer, J. J. (1997). Training complex cognitive skills: a four-component instructional design model for technical training. Englewood Cliffs, NJ: Educational Technology Publications. Van Merriënboer, J. J., Jelsma, O., & Paas, F. G. (1992). Training for reflective expertise: a four-component instructional design model for complex cognitive skills. Educational Technology Research and Devel- opment, 40(2), 23–43. https://doi.org/10.1007/BF02297047. Van Merriënboer, J. J., Clark, R. E., & De Croock, M. B. (2002). Blueprints for complex learning: the 4 C/ ID-model. Educational technology research and development, 50(2), 39–61. Van Merriënboer, J. J., & Kirschner, P. A. (2017). Ten Steps to Complex Learning: A Systematic Approach to Four-Component Instructional Design (3rd ed.). Routledge. https://doi.org/10.4324/9781315113210 Radianti, J., Majchrzak, T. A., Fromm, J., & Wohlgenannt, I. (2020). A systematic review of immersive virtual reality applications for higher education: design elements, lessons learned, and research agenda. Computers & Education, 147, 103778. https://doi.org/10.1016/j.compedu.2019.103778. Sacks, R., Perlman, A., & Barak, R. (2013). Construction safety training using immersive virtual reality. Construction Management and Economics, 31(9), 1005–1017. https://doi.org/10.1080/01446193.201 3.828844. Schrepp, M. (2015). User experience questionnaire handbook. https://doi.org/10.13140/RG.2.1.2815.0245 Slater, M., Khanna, P., Mortensen, J., & Yu, I. (2009). Visual realism enhances realistic response in an immer- sive virtual environment. IEEE computer graphics and applications, 29(3), 76–84. Slater, M., & Sanchez-Vives, M. V. (2016). Enhancing our lives with immersive virtual reality. Frontiers in Robotics and AI, 3, 74. https://doi.org/10.3389/frobt.2016.00074. Smith, S. P., & Burd, E. L. (2019). Response activation and inhibition after exposure to virtual reality. Array, 3, 100010. https://doi.org/10.1016/j.array.2019.100010. Stone, R. T., McLaurin, E., Zhong, P., & Watts, K. P. (2013). Full virtual reality vs. integrated virtual reality training in welding. Welding Journal, 92(6), 167. Xie, Q. (2021). Applying vocational education and training pedagogy in business English courses for China’s English major undergraduates. Emerald, 65(2), 292–312. Zender, R., Sander, P., Weise, M., Mulders, M., Lucke, U., & Kerres, M. (2019). HandLeVR: Action-Ori- ented Learning in a VR Painting Simulator. In International Symposium on Emerging Technologies for Education (pp. 46–51). Springer, Cham. Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. Authors and Affiliations 1 2 1 Miriam  Mulders  · Josef  Buchner  · Michael  Kerres Miriam Mulders miriam.mulders@uni-duisburg-essen.de Josef Buchner josef.buchner@phsg.ch Michael Kerres michael.kerres@uni-duisburg-essen.de Chair of Educational Technology and Instructional Design, University of Duisburg-Essen, Universitätsstraße 2, 45127 Essen, Germany St. Gallen University of Teacher Education, Müller-Friedbergstraße 34, 9400 Rorschach, Switzerland 1 3

Journal

"Technology, Knowledge and Learning" – Springer Journals

Published: Nov 23, 2022

Keywords: Virtual Reality; 4C/ID model; Competence development; Skills acquisition; Vocational education; Apprenticeship training

There are no references for this article.