Preface

Augmented Reality (AR) technologies and tools have found numerous applications since their appearance two decades ago. At present, applications can be found in the gaming world, the movie industry, advertising, interior design, fashion, education and learning, medical and surgical operations, product design and manufacturing, construction and archeological restoration, and countless other areas. AR is a natural development from virtual reality (VR), which was developed several decades before AR. In terms of application, AR complements VR in many ways. Due to the advantages of a user being able to see both the real and virtual objects simultaneously, AR has the upper hand, though it is not completely free from human factors and other restrictions. AR also doesn't consume as much time and effort in many applications because it's not required to construct the entire virtual scene, which can be tedious and time-consuming.

In this book, several new and emerging application areas of AR are presented. It is divided into three sections. The first section contains applications in outdoor and mobile AR, such as construction, restoration, security, and surveillance. The second section deals with AR in medical, biological, and human bodies. The third and final section contains a number of new and useful applications in daily living and learning.

#### *Section 1 – Outdoor and Mobile AR Applications (Chapters 1-4)*

In Chapter 1, Ai and Livingston described a mixed reality (MR) based system for security monitoring, and large area intelligence gathering or global monitoring, where geo-registered information is integrated with live video streams. The authors called this Collaborative AR because the 3D models, aerial photos from Google Earth, and video streams are combined to form one MR environment in real time.

In Chapter 2, Gimeno et al. presented an AR CAD system at construction sites. Mobile computing has been suggested as a feasible platform for the development of AR applications for construction sites. Their system manages three different sources of information: viz., background images, AutoCAD DXF as 2D design plans and as-built images. By merging these data, a new augmented CAD (AR-CAD) data model is defined, allowing building plans to be annotated with real images from the current state of the building work.

#### XII Preface

In Chapter 3, Luo presented a new computing paradigm called Cloud-Mobile Convergence (CMC) for implementing a mobile AR system. The design principle of CMC is introduced and several sample scenarios were applied to illustrate the paradigm developed. Scalable gesture interaction for large display systems has been demonstrated. The CMC approach has good potential to be used in a wide range of mobile AR systems.

Preface XI

In Chapter 9, Stadon addresses social and cultural impacts of mixed reality systems, using traditional explanation of humans integrating themselves as individuals in a greater social context. The chapter then discusses the "deterritorialisation" of the human body through its dispersion into multiple reality manifestations in relation to mixed reality data transfer, which can be both biological and physical, e.g. bioimaging, motion tracking, bio-microscopy, etc. The so-called "hypersurfacing" system is discussed, and this could result in a media convergence, creating the collective

In Chapter 10, Wen et al. developed an AR interface for robot-assisted surgery. AR technology is used as a therapeutic intervention combining the virtual augmented physical model with locally detected real-time medical information such as geometric variance and respiration rate. The interface is coupled with the augmented physical model, the surgeon's operation, and robotic implementation through vision-based tracking and hand gesture recognition. The interface provides a powerful integrated medical AR platform linking all other medical devices and equipment in the operating

*Section 3 – Novel AR Applications in Daily Living and Learning (Chapters 11-13)* 

In Chapter 11, an AR platform for collaborative e-maintenance system is described by Benbelkacem et al. Their study comprises of the establishment of a distributed platform for collaboration between technicians and remote experts using AR techniques. A collaboration strategy based on Service Oriented Architecture (SOA) is proposed. Maintenance procedures are transferred from the remote expert to the work site in real time, creating a visual space shared by the technician and the remote

In Chapter 12, Wang and Chiu described the use of AR technology for effective use in education to enhance the students for more productive learning. The Multi-user augmented reality integrated system (OMARIS) was developed to offer instructional material, providing personal AR learning and collaborative AR learning systems to be

In Chapter 13, Betancur presented a Head-Up Display (HUD) system in projecting the dashboard information onto the windshield of an automobile. This chapter focuses on the approach of the functional design requirements of the HUD in current automobiles. The automobile's display information, such as driving speed, engine rotation speed, music system, etc. can be displayed onto the windshield, thus easing the driver from the need of looking down at the dashboard, while at the same time watching the road condition. This system provides an improved virtual user interface,

This book presents a snapshot of some of the useful and emerging applications of AR technologies, while hundreds of other applications have been reported elsewhere.

more flexible with use and reuse of AR materials.

and could eliminate any potential distraction from the driver.

intelligence which exists in a global society of knowledge transfer.

theatre.

expert.

In Chapter 4, Saggio and Borra used AR tools for the realization of virtual reconstruction/restoration of historical structures with artistic or historical values, heritage, cultural artifacts, etc., before starting such a project. The role played by AR is highlighted, among other various techniques and applications, such as autostereoscopy, different input devices, human-computer interaction, etc. New methods and materials for future work in reducing time, effort, and cost are also mentioned.

#### *Section 2 – AR in Biological, Medical and Human Modeling and Applications (Chapters 5-10)*

In Chapter 5, Engwall constructed a computer-animated face of a speaker, the talking head, to produce the same articulatory movements as the speaker. This development has good potential for supporting speech perception and production. The developed speech perception support is less susceptible to automatic speech recognition errors, and is more efficient in displaying the recognized text strings. The AR talking head display also allows a human or virtual instructor to guide the learner to change the articulation for achieving the correct pronunciation.

In Chapter 6, Woodward and Hakkarainen reported the application of AR in the architecture, engineering, and construction sector using mobile technology. The chapter presents an overall review of their software system, its background, current state, and future plans. The lightweight mobile phone is used to implement the system. Field test results are tested and presented.

In Chapter 7, NeuAR, an AR application in the neurosciences area, was reported by Gamito et al. This chapter first describes the application of virtual reality (VR) in treating mental disorders, such as phobias like acrophobia, agoraphobia, schizophrenia, and rehabilitation of post-traumatic stress disorder, traumatic brain injury, etc. The authors then mentioned that AR presents additional advantages over VR since the patients can see their own hands and arms in AR while in VR, avatars to simulate patients' bodies need to be built, but they are never realistic in most cases.

In Chapter 8, AR-assisted therapy for upper limb rehabilitation is reported by Jordan and King. AR provides a composite view of the real and virtual and hence has significant advantages over VR for neurorehabilitation. Many physical issues giving rise to a stroke-induced impoverished environment can be solved or circumvented using augmented environments. The system they developed has the potential to provide a calibrated range of exercises to suit the physical and cognitive abilities of a patient.

In Chapter 9, Stadon addresses social and cultural impacts of mixed reality systems, using traditional explanation of humans integrating themselves as individuals in a greater social context. The chapter then discusses the "deterritorialisation" of the human body through its dispersion into multiple reality manifestations in relation to mixed reality data transfer, which can be both biological and physical, e.g. bioimaging, motion tracking, bio-microscopy, etc. The so-called "hypersurfacing" system is discussed, and this could result in a media convergence, creating the collective intelligence which exists in a global society of knowledge transfer.

X Preface

mobile AR systems.

patient.

In Chapter 3, Luo presented a new computing paradigm called Cloud-Mobile Convergence (CMC) for implementing a mobile AR system. The design principle of CMC is introduced and several sample scenarios were applied to illustrate the paradigm developed. Scalable gesture interaction for large display systems has been demonstrated. The CMC approach has good potential to be used in a wide range of

In Chapter 4, Saggio and Borra used AR tools for the realization of virtual reconstruction/restoration of historical structures with artistic or historical values, heritage, cultural artifacts, etc., before starting such a project. The role played by AR is highlighted, among other various techniques and applications, such as autostereoscopy, different input devices, human-computer interaction, etc. New methods and materials for future work in reducing time, effort, and cost are also mentioned.

*Section 2 – AR in Biological, Medical and Human Modeling and Applications (Chapters 5-10)* 

In Chapter 5, Engwall constructed a computer-animated face of a speaker, the talking head, to produce the same articulatory movements as the speaker. This development has good potential for supporting speech perception and production. The developed speech perception support is less susceptible to automatic speech recognition errors, and is more efficient in displaying the recognized text strings. The AR talking head display also allows a human or virtual instructor to guide the learner to change the

In Chapter 6, Woodward and Hakkarainen reported the application of AR in the architecture, engineering, and construction sector using mobile technology. The chapter presents an overall review of their software system, its background, current state, and future plans. The lightweight mobile phone is used to implement the

In Chapter 7, NeuAR, an AR application in the neurosciences area, was reported by Gamito et al. This chapter first describes the application of virtual reality (VR) in treating mental disorders, such as phobias like acrophobia, agoraphobia, schizophrenia, and rehabilitation of post-traumatic stress disorder, traumatic brain injury, etc. The authors then mentioned that AR presents additional advantages over VR since the patients can see their own hands and arms in AR while in VR, avatars to simulate patients' bodies need to be built, but they are never realistic in most cases.

In Chapter 8, AR-assisted therapy for upper limb rehabilitation is reported by Jordan and King. AR provides a composite view of the real and virtual and hence has significant advantages over VR for neurorehabilitation. Many physical issues giving rise to a stroke-induced impoverished environment can be solved or circumvented using augmented environments. The system they developed has the potential to provide a calibrated range of exercises to suit the physical and cognitive abilities of a

articulation for achieving the correct pronunciation.

system. Field test results are tested and presented.

In Chapter 10, Wen et al. developed an AR interface for robot-assisted surgery. AR technology is used as a therapeutic intervention combining the virtual augmented physical model with locally detected real-time medical information such as geometric variance and respiration rate. The interface is coupled with the augmented physical model, the surgeon's operation, and robotic implementation through vision-based tracking and hand gesture recognition. The interface provides a powerful integrated medical AR platform linking all other medical devices and equipment in the operating theatre.

#### *Section 3 – Novel AR Applications in Daily Living and Learning (Chapters 11-13)*

In Chapter 11, an AR platform for collaborative e-maintenance system is described by Benbelkacem et al. Their study comprises of the establishment of a distributed platform for collaboration between technicians and remote experts using AR techniques. A collaboration strategy based on Service Oriented Architecture (SOA) is proposed. Maintenance procedures are transferred from the remote expert to the work site in real time, creating a visual space shared by the technician and the remote expert.

In Chapter 12, Wang and Chiu described the use of AR technology for effective use in education to enhance the students for more productive learning. The Multi-user augmented reality integrated system (OMARIS) was developed to offer instructional material, providing personal AR learning and collaborative AR learning systems to be more flexible with use and reuse of AR materials.

In Chapter 13, Betancur presented a Head-Up Display (HUD) system in projecting the dashboard information onto the windshield of an automobile. This chapter focuses on the approach of the functional design requirements of the HUD in current automobiles. The automobile's display information, such as driving speed, engine rotation speed, music system, etc. can be displayed onto the windshield, thus easing the driver from the need of looking down at the dashboard, while at the same time watching the road condition. This system provides an improved virtual user interface, and could eliminate any potential distraction from the driver.

This book presents a snapshot of some of the useful and emerging applications of AR technologies, while hundreds of other applications have been reported elsewhere.

#### XIV Preface

With the rapid advent of tools and algorithms contributed by thousands of scientists and technologists worldwide, AR is expected to shape the world that we live in, by connecting every person and object in an unprecedented way since the development of IT. We truly look forward to an augmented world, body and life, to come in time.

Special thanks are due to Associate Professor S. K. Ong for making valuable discussions and suggestions during the editing of the book. This is much appreciated by the Editor Professor A. Y. C. Nee.

November, 2011

**A.Y.C. Nee**  National University of Singapore
