AUGMENTED REALITY PROJECTS

Augmented Reality User Interfaces using fingertips real hands, multimodal interaction using gesture and speech input, AR Games using HMD and more..

AR Coloring Book

Brings existing physical copies of books to life using AR. A texturing process that applies the captured texture from a 2-D colored drawing to both the visible and occluded regions of a 3-D character in real time.

AR Toy

We indicate the 3D object or real object as an input on Handheld AR interface, combining with speech recognition it is a potential interaction method for a user to use their speech to interact with virtual object in the AR scene.

Multimodal AR Interaction

In this work we describe an advantage of multimodal AR interfaces using gestures and speech input which allows real-time 3D interaction is modified intuitively by engaging with multimodal fusion.

Interactive AR Popup Book

3D hand interface provides users a seamless interaction in AR environments using real hands as an interaction tool. There is no need to have physical markers or devices for interaction.

AR Interior Design

Gaze interaction in a context sensing to view information over time. Users to create their own information for places or contents and interact with the physical world in ways not experienced before.

 

Fingertips AR Interaction

Mobile Augmented Reality User Interfaces using fingertips real hands instead touch screen. Contribution: allows user to interact with virtual 3D models in the work area using interaction metaphors in mobile environment.

 

AR Jenga Game using HMD

A vision capability enables the immersion and interactivity in mobile augmented reality to improve gaming experiences by enabling game physics to apply to real world surfaces and objects for AR environments – Developer : Solomon

AR Autonomous Agents

Character Animation Using Augmented Reality Technique for Autonomous Agents, Embodied autonomous agents – use of animated characters in augmented reality applications.

 

VIRTUAL REALITY PROJECTS

Fully immersive environment through Virtual Reality User Interfaces using Oculus Touch devices, Leapmotion and Depth sensors Kinect to produce natural interaction and enhance the effectiveness in interaction.

Oculus Touch Experience

Virtual reality creates immersive fully immersive computer-generated environments to imitate the real world

Oculus with Leap Motion

Virtual reality creates immersive fully immersive computer-generated environments to imitate the real world

VR Manufacturing

Virtual reality creates immersive fully immersive computer-generated environments to imitate the real world

VR Ancient Malacca

Virtual reality creates immersive fully immersive computer-generated environments to imitate the real world

Virtual Mooc Teaching

Virtual reality creates immersive fully immersive computer-generated environments to imitate the real world

Virtual Classroom

Virtual reality creates immersive fully immersive computer-generated environments to imitate the real world

VR Assessment

Virtual reality creates immersive fully immersive computer-generated environments to imitate the real world

Virtual Whiteboard

Virtual reality creates immersive fully immersive computer-generated environments to imitate the real world

CLASSROOM OF THE FUTURE : The exciting future of education with virtual reality

In response to the challenge of the 4th Industrial Revolution and in line with the MoHE’s intention to Redesigning Higher Education, we created VR classroom for students to experience the immersive learning environment. As a case study, Oil and Gas is chosen and Human Anatomy study is explored throughout the development of classroom of the future. With the cross-discipline collaboration between Faculty of Chemical and Energy Engineering and Faculty of Computing, this project is delivered the content where the UTM students able to have onsite visit to the offshore platform during their studies in UTM. Visiting offshore is practically impossible for students to participate with the actual environment due to the safety matters and cost. Through this project, it brings the students with a new learning experience.

Project’s members: Dr. Ajune Wanis (VR/AR), Assoc. Dr. Mohd Shahrizal (VR), Dr.Masitah (HCI), Dr. Mazura (Chemical Engineering), Dr. Zaki Yamani (Chemical Engineering), Dr. Wan Rosli  (Petroleum Engineering)

Technical Team : Dr. Ajune (VR/AR), Yahya Fekri (Senior Engineer VR), Asyraf (Gesture Interaction), Azhar (Content Developer and animation), Shukri (UI/UX Effects and sounds), and Affendy (Interface/Integration)

MaGICX Classroom of the Future, has been successfully launched by Malaysia Ministry of Education. In response to the challenge of the 4th Industrial Revolution, MoHE’s intention to Redesigning Higher Education. MaGICX UTM is introducing the concept of Classroom of the Future.