School of Science and Technology 科技學院
Computing Programmes 電腦學系

VR REHEARSAL SIMULATOR

WONG Tsz Hin, CHAN Pui Ho, CHENG Kai Yuen

  
ProgrammeBachelor of Computing with Honours in Internet Technology
SupervisorDr. Raymond Pang
AreasVirtual Reality Applications
Year of Completion2017

Objectives

The aim of our project is to reduce the cost of doing a real practice for practice teachers with the use of VR classroom rehearsal simulator. The practice teachers can use our VR rehearsal simulator. It can enhance practice efficiency. Practice teachers and the experienced teacher can use application to know the report and the result of the user. The report will record the grades for the teacher. And give them some suggestion to improve themselves. Also, the application has the interactive system. It has some basic interactive to the user who using this VR application. Such as voice command input, eyes contact. Application has some different burst situation; it need the teachers to handle and make some decide. Therefore, the VR rehearsal simulator have the Situation editor, user can modify the rehearsal situation. User can modify the Difficulty level.

To achieve the aim, the main objective of the project is to develop a class practice of VR rehearsal simulator that the practice teachers can do the practice using by the virtual reality.

The project has defined a few sub-objectives as follows:

  • Scenes of Object
    • Build up the VR artificial world, the classroom environment. Such as the desk, chair, board, student.
    • Integration all element in to the artificial world.
  • Interactive System
    • Capture the user of eye content or voice command using the sensor (Gyrometer) and microphone.
    • Analyze the eye content to which object.
    • Create virtual students that can response, such as visually reflects
  • User Interface and reporting
    • Build up the menu for user to select different case and option.
    • Capture the user using the simulator in different case.
    • Analysis the user makes the decision are right way or wrong way.
    • Report to the user and suggest some way to improve them.
 

Background and Methodology

 

In this project, we will have several components in our project. We include to build up the virtual classroom, situation handle and generate evaluation report. The following functions in those systems are build up the virtual classroom, menu on start page, selection dialog, capture the user of eye content and build up the dynamic VR object.

In this project, my works is about the front-end of the application: building up the static model/object, all the models are save as. fbx format and place in Assert folder. After that I will combine them to be a classroom environment and display them in teacher's point of view. Also, I expect that I will make them become close to the real Hong Kong classroom in daily life. So, that user can feel more immersive and make the rehearsal be more effectively.

Fig. 1 System Overview

Fig.2 Classroom material

Conclusion

After we finish make out application and did the evaluation, we find that our system can help some students who will join the education sector. Our application has 2 main benefit for can help them. First, practice teachers can reduce nervous after using our application. The second one that can more opportunity for doing practice, because practice teachers didn't have many opportunities to do the real practice. Our application can let them do the practice at any time and everywhere.

But at the same time, we need to do some improve. After doing the evaluation, we have some feedback about the application, some feedback is talking about some benefit, also it has some shortage of our application. We need to increase the reality and scene optimization, upload materials and audio record in the system and improve the input method. We know our application not really reality, we may use some better material and texture in the scene. Also, we need to improve the system, let user can upload class materials and listen the audio record in the system. Because we don't want user use much time to find the location to upload the class materials and listen the record. The last one, it improves the input method, some user said that the pointer is difficult to trigger the voice recognition function.