School of Science and Technology 科技學院
Computing Programmes 電腦學系

Not Just A Wall: Mobile Augmented Reality and for Sharing Multimedia Campus Moments and Enhancing Campus Climates

Hung Wing Sum, Jian Guang Yao and Li Wing Chi

Programme Bachelor of Science with Honours in Internet Technology
Supervisor Dr. Andrew Lui
Areas Virtual Reality and Augmented Reality Applications
Year of Completion 2016

Objectives

The aim of this project is to develop a mobile application to connect OUHK students through the things on campus in order to improve students' sense of belonging. The mobile phone allows students to interact with the server in a specific place with the support of camera and Augmented Reality technology.

This application focuses on providing a virtual platform for OUHK students to share their campus life with each other and facilitate their discussion on common experiences that they can relate to. Internet-of-Things is the idea that carries out this project. By utilizing this application, OUHK students can improve their sense of belonging and enjoy being a part of it. Students can build up stronger relationship and connection with others. The project objectives are:

Identify the markers of Augmented Reality to facilitate the connection between students' smart-phone and campus.

  • Design the presentation of artifacts to display virtually on the marker.
  • Design a membership system to identify students' identity and authority to use the application.
  • Design and develop a like-photo system to facilitate the interaction between students.
  • Evaluate the developed prototype if it can improve students' sense of belonging.

Background and Methodology

The wall itself is a good material of displaying things. The OUHK campus has so many walls and some used for putting notes and news. However, most of them are not utilized well. By exploiting the walls, virtual walls take place. A virtual wall is like a virtual installation art composed of photos and decorations attached to the wall in Augmented Reality environment.

The solution is to develop an Android mobile application with the server. Users access AR camera to view attractive and artistic walls. It requires AR technologies for marker identification and virtual presentation of a gallery.

The homepage on the left is what guests will see when they open the application. After the user logs into their account, it provides four functions to the user. They are AR camera, profile, my gallery, and upload function.

The user selects the location of the campus to put a meaningful photo by the spinner. Then, user can choose to take a photo instantly or grab from the phone album. A caption can be added before the photo is uploaded.

There are three main features that users can use once the photos and AR decorations show up on the wall. They are sharing tool, off marker viewing, and paging tool.

User can share the current view as a photo to social media. User can choose to share the view to different social media and write some comments.

User can choose to view the scene off marker, which the user does not need to point the AR camera all the time once the AR scene is shown. Once the off maker function is used, a control panel can be used to browse the off marker scene. Then the AR scene can be viewed in 360 degrees horizontally and vertically.

Each individual image can be further expanded. User can view the photo clearly and the description of the photo is provided.

Evaluation

A group of computing students was chosen to be the main testers due to there is a particular design in the computing labs towards the 4th floor signage. Computing students spend so much time on computer labs. It is sensible that collecting their feedback for evaluating the result of application. After-use survey collects information about functional and non-functional performance of NJAW. Questions involve user satisfaction, response performance, aim effectiveness and improvement.

90% participants like the virtual design presentation on the wall and only 10% participants indicate neutral. Therefore, users like the virtual design and agree NJAW provides a virtual and artistic platform.

30% participants strongly agree NJAW is easy to use and 70% participants agree NJAW is easy to use. All students agree NJAW is easy to use. It seems that NJAW provides an easy to use platform for users to share campus life by Internet of things.

40% participants strongly agree the AR camera is convenient to use and 60% participants agree AR camera is convenient to use. All students agree AR camera is convenient to use. It may due to the off-marker function because the users can still view photo even though leaving the wall.

80% participants disagree that they have difficulties in identifying the walls to display photo virtually and only 20% participants indicate neutral. Therefore, users have few difficulties to use augmented reality function to identify the wall.

Conclusion and Future Development

All components are completely developed and the project enters the right track. The result is summarized that NJAW is feasible and effective to improve student's sense of belonging to campus and their connections. Functionally, the Pair-T-test result indicates NJAW provides a good platform for students to share their campus life and interact with others. In the non-functional aspect, the after-use survey reported that NJAW is easy to use and testers do not have difficulties in identifying AR marker. The UAT reported image loading time and AR recognition time are acceptable. Based on the results, NJAW achieves the aim and objectives.

For more interactions, commenting function can be added in future. A user can give comments to other's photo and the receiver or everyone could view on the comments. The comments could be a better way to express what the reader would like to tell and it increases the communications between users. Not only words, but also images are supported to put in a comment. Response with photos is more interesting and photos with related campus life may be used as a comment so a single post is able collect more campus climates and may result more meaningful.

Copyright Hung Wing Sum, Jian Guang Yao, Li Wing Chi and Andrew Lui 2016

Jonathan Chiu
Marketing Director
3DP Technology Limited

Jonathan handles all external affairs include business development, patents write up and public relations. He is frequently interviewed by media and is considered a pioneer in 3D printing products.

Krutz Cheuk
Biomedical Engineer
Hong Kong Sanatorium & Hospital

After graduating from OUHK, Krutz obtained an M.Sc. in Engineering Management from CityU. He is now completing his second master degree, M.Sc. in Biomedical Engineering, at CUHK. Krutz has a wide range of working experience. He has been with Siemens, VTech, and PCCW.

Hugo Leung
Software and Hardware Engineer
Innovation Team Company Limited

Hugo Leung Wai-yin, who graduated from his four-year programme in 2015, won the Best Paper Award for his ‘intelligent pill-dispenser’ design at the Institute of Electrical and Electronics Engineering’s International Conference on Consumer Electronics – China 2015.

The pill-dispenser alerts patients via sound and LED flashes to pre-set dosage and time intervals. Unlike units currently on the market, Hugo’s design connects to any mobile phone globally. In explaining how it works, he said: ‘There are three layers in the portable pillbox. The lowest level is a controller with various devices which can be connected to mobile phones in remote locations. Patients are alerted by a sound alarm and flashes. Should they fail to follow their prescribed regime, data can be sent via SMS to relatives and friends for follow up.’ The pill-dispenser has four medicine slots, plus a back-up with a LED alert, topped by a 500ml water bottle. It took Hugo three months of research and coding to complete his design, but he feels it was worth all his time and effort.

Hugo’s public examination results were disappointing and he was at a loss about his future before enrolling at the OUHK, which he now realizes was a major turning point in his life. He is grateful for the OUHK’s learning environment, its industry links and the positive guidance and encouragement from his teachers. The University is now exploring the commercial potential of his design with a pharmaceutical company. He hopes that this will benefit the elderly and chronically ill, as well as the society at large.

Soon after completing his studies, Hugo joined an automation technology company as an assistant engineer. He is responsible for the design and development of automation devices. The target is to minimize human labor and increase the quality of products. He is developing products which are used in various sections, including healthcare, manufacturing and consumer electronics.

Course Code Title Credits
  COMP S321F Advanced Database and Data Warehousing 5
  COMP S333F Advanced Programming and AI Algorithms 5
  COMP S351F Software Project Management 5
  COMP S362F Concurrent and Network Programming 5
  COMP S363F Distributed Systems and Parallel Computing 5
  COMP S382F Data Mining and Analytics 5
  COMP S390F Creative Programming for Games 5
  COMP S492F Machine Learning 5
  ELEC S305F Computer Networking 5
  ELEC S348F IOT Security 5
  ELEC S371F Digital Forensics 5
  ELEC S431F Blockchain Technologies 5
  ELEC S425F Computer and Network Security 5
 Course CodeTitleCredits
 ELEC S201FBasic Electronics5
 IT S290FHuman Computer Interaction & User Experience Design5
 STAT S251FStatistical Data Analysis5
 Course CodeTitleCredits
 COMPS333FAdvanced Programming and AI Algorithms5
 COMPS362FConcurrent and Network Programming5
 COMPS363FDistributed Systems and Parallel Computing5
 COMPS380FWeb Applications: Design and Development5
 COMPS381FServer-side Technologies and Cloud Computing5
 COMPS382FData Mining and Analytics5
 COMPS390FCreative Programming for Games5
 COMPS413FApplication Design and Development for Mobile Devices5
 COMPS492FMachine Learning5
 ELECS305FComputer Networking5
 ELECS363FAdvanced Computer Design5
 ELECS425FComputer and Network Security5